-- Logs begin at Thu 2022-09-01 17:10:39 UTC, end at Thu 2022-09-01 18:23:50 UTC. -- Sep 01 17:43:03.977322 dv-cinder-749155-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 17:43:03.986630 dv-cinder-749155-10-smb devstack@keystone.service[81616]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:43:03 2022] *** Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: nodename: dv-cinder-749155-10-smb Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: machine: x86_64 Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: clock source: unix Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: pcre jit disabled Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: detected number of CPU cores: 4 Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: current working directory: / Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:43:03.988682 dv-cinder-749155-10-smb devstack@keystone.service[81616]: your processes number limit is 47680 Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: your memory page size is 4096 bytes Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: detected max file descriptor number: 2048 Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: lock engine: pthread robust mutexes Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: thunder lock: enabled Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 17:43:03.989434 dv-cinder-749155-10-smb devstack@keystone.service[81616]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:43:04.028033 dv-cinder-749155-10-smb devstack@keystone.service[81616]: Python main interpreter initialized at 0x562c4d8619c0 Sep 01 17:43:04.028033 dv-cinder-749155-10-smb devstack@keystone.service[81616]: python threads support enabled Sep 01 17:43:04.028033 dv-cinder-749155-10-smb devstack@keystone.service[81616]: your server socket listen backlog is limited to 100 connections Sep 01 17:43:04.028033 dv-cinder-749155-10-smb devstack@keystone.service[81616]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:43:04.028380 dv-cinder-749155-10-smb devstack@keystone.service[81616]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:43:04.028451 dv-cinder-749155-10-smb devstack@keystone.service[81616]: *** Operational MODE: preforking *** Sep 01 17:43:04.028714 dv-cinder-749155-10-smb devstack@keystone.service[81616]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:43:04.028714 dv-cinder-749155-10-smb devstack@keystone.service[81616]: spawned uWSGI master process (pid: 81616) Sep 01 17:43:04.028916 dv-cinder-749155-10-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 17:43:04.030070 dv-cinder-749155-10-smb devstack@keystone.service[81616]: spawned uWSGI worker 1 (pid: 81628, cores: 1) Sep 01 17:43:04.030070 dv-cinder-749155-10-smb devstack@keystone.service[81616]: spawned uWSGI worker 2 (pid: 81629, cores: 1) Sep 01 17:43:04.030070 dv-cinder-749155-10-smb devstack@keystone.service[81616]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:43:08.397909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:43:08.397909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: from cryptography.utils import int_from_bytes Sep 01 17:43:08.398746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:43:08.398746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: from cryptography.utils import int_from_bytes Sep 01 17:43:08.399290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:43:08.399290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: from cryptography.utils import int_from_bytes Sep 01 17:43:08.399741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:43:08.399741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: from cryptography.utils import int_from_bytes Sep 01 17:43:08.449644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:43:08.449844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:43:08.450002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] command line args: [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:43:08.450267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:43:08.450443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ================================================================================ {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:43:08.450693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] admin_token = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.450957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] config_dir = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.451142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.451325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] config_source = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.451501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] debug = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.451695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.452062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.452236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.452344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:43:08.452483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.452586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:43:08.452696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] command line args: [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:43:08.452797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.452929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:43:08.453037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_config_append = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ================================================================================ {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:43:08.453333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] admin_token = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_dir = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_file = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] config_dir = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.453914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] config_source = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] debug = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.454950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_config_append = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_dir = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.455952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_file = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.456860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] publish_errors = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.457880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.458871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] standard_threads = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.459862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] use_journal = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] use_json = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] use_stderr = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] publish_errors = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] use_syslog = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.460881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.461043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.461119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.461273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.461410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.461509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] standard_threads = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.461585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.461740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.461819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.461969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.462043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.462145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.462219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.462896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] use_journal = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.463049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] use_json = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.463125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.463247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] use_stderr = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.463390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] use_syslog = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.463465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.463624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:43:08.463710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.463882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.463958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464120 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.464929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.465877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.466864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.467997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.468923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.469869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.470961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.471957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.472878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.473920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.474952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.475863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.476934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.477878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.478042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.478682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.478798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.478934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.479922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.480876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.481958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.482934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.483949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.484849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.485940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.486880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.external = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.487854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.password = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] auth.token = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.488936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.external = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.489963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.password = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] auth.token = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.490877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.491892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.492859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.493905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.494888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.495848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.496966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497679 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.497993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.498873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.499896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.500984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.501936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.502956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.503900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.504996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.505989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.506953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.507869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.508957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.509046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.509704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.509793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.509993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.510971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.511939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.512857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.513959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.514988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.515935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.516861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.517972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.518952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.519980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.520920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] role.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] role.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.521853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.522988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] role.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] role.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.523929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.524734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.525463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.525561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.525819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.525958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.526974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.527956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.528929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.529957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.530940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.531988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.532929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.533895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.534897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.connection = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.535982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.536994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.connection = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.537933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.538896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.539049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.539127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.539210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:43:08.539285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.539529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.539768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.540021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.540263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.540560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.540945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.541192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.541432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:43:08.541606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:43:08.568700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.568927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.569152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.570288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.570527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.570777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.578208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.579756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.607157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.607379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.608636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.608873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.662574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.662791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.713155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.713401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.716481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.716712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.879973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.880053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.880191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.880274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.880408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.904972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.905097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.905178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.905311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.905390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.905525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.918619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.918788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.932991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81628) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.933893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:43:08.956752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.956941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.957054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:43:08.957160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:43:08.957284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.957389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.957490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:43:08.957588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:43:08.957799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.957922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.958770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.968398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.968673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.968938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.969023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.969213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.969299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.969499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.969783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.976208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:08.976808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:08.979313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:08.979595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.979875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:08.980436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.980962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.981881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.982074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.982154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.982343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.982613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:08.982904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.005360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.006669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.006823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.007107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.008159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.008445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.012402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.012683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.012962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.013970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.014263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.014538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.019523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.019810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.021173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.021465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.024045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.024333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.024683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.025328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.029883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.029970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.030319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.046149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.046432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.050420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.053736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.053997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.054135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.054302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.059098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.060610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.062448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.062764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.063807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.066937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.067029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.067239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.067525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.067811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.068094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.068485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.070127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.074120 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.074412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.074694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.074996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.075286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.075561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.085610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.085901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.086170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.086439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.091738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.092027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.092289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.092546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.093691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.095415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.096963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.097240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.099617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.099912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.100195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.100487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.100783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.101070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.101291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.102884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.103175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.105786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.106075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.106461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.106778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.107069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.112940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.113227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.113509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.113793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.114073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.114351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.114645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.118300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.119107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.122780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.122780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.122780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.122780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.122780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.131115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.134137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.136921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.138093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.139575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.139923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.141066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.141351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.141641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.142820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.144252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.145876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.146159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.146439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.148220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.149704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.153078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.153172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.153409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.153694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.153976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.154540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.157621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.157911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.158196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.158472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.162105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.162453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.162717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.166581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.166906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.167184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.170177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81628) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.170415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.170694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.170995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.171268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.171546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.171823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.172099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.172390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.172669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.172940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.173199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.173461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.173736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81628) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.174338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:43:09.174618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.174927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.175199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.175464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.175729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.176006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.176277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.176559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.176830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.177095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.177354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.177614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.177878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:43:09.210257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c4d8619c0 pid: 81628 (default app) Sep 01 17:43:09.213839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c4d8619c0 pid: 81629 (default app) Sep 01 17:43:09.214323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a91942-33d1-493e-9082-1b242064dc5e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:09.214606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a91942-33d1-493e-9082-1b242064dc5e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:09.214915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a91942-33d1-493e-9082-1b242064dc5e None None] PATH_INFO: `/v3` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:09.219095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Thu Sep 1 17:43:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:17.070885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:17.071431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:17.072067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:17.076428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:17.081657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:17.082125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:17.082224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:17.165698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: INFO dbcounter [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] Registered counter for database keystone Sep 01 17:43:17.188537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG oslo_db.sqlalchemy.engines [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:43:17.194841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writer thread running {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:43:17.376266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG passlib.handlers.bcrypt [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81628) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 17:43:17.376664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG passlib.handlers.bcrypt [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81628) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 17:43:17.434898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:17.439598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:17.569299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 17:43:18.081690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:18.152085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: INFO dbcounter [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] Registered counter for database keystone Sep 01 17:43:18.170901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG oslo_db.sqlalchemy.engines [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:43:18.177033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writer thread running {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:43:18.303877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1506d-34ec-468f-8056-4b06fc2a8fd2 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:18.309150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:18.309784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:18.310074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:18.310344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:18.318572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:18.371236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING keystone.common.rbac_enforcer.enforcer [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 17:43:18.374792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c201a-ea7a-43be-bd8e-87bca9c3e00f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:18.381093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Sep 1 17:43:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:18.387207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:18.401675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f9bdd-089c-4fa9-8c49-8f5d2b85e297 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:18.406372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:18.407501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:18.407786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:18.408065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] PATH_INFO: `/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:18.409648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] RBAC: Authorizing `identity:get_project(project_id=96c7134db2ce4630a56e3b2cec77b0cf)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:18.465563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 17:43:18.465913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9049-9191-4acd-a277-c22ff244f6ae admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:18.470478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Thu Sep 1 17:43:18 2022] GET /identity/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:20.374664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876671-ce61-4e68-bc01-327aaefd201b None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:20.375233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876671-ce61-4e68-bc01-327aaefd201b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:20.375233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876671-ce61-4e68-bc01-327aaefd201b None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:20.379390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:20.384875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:20.385303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:20.385396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:20.405538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:20.407085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:20.414796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 17:43:20.683218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876671-ce61-4e68-bc01-327aaefd201b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:20.695388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876671-ce61-4e68-bc01-327aaefd201b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:20.700110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:20.700704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:20.700983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:20.701254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:20.708812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:20.710607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebd75-ea30-470d-9952-c2d0a0131062 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:20.721799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Thu Sep 1 17:43:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:20.727101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:20.736155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25cfc-efab-42a2-bdee-b67e4e4e8cf5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:20.740504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:20.741233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:20.741514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:20.741785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:20.743121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:20.745021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e51b9-34f0-4ed4-a4dd-d1ac01cb9129 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:20.746534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Thu Sep 1 17:43:20 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:22.751112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a30b-d999-4ad1-85e4-ebdd2bbb71b3 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:22.751662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a30b-d999-4ad1-85e4-ebdd2bbb71b3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:22.751662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a30b-d999-4ad1-85e4-ebdd2bbb71b3 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:22.752989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:22.760615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:22.761093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:22.761273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:22.789363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:22.790806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:22.824173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b218-1452-45f0-a35b-eff13bc0b034 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:22.824537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b218-1452-45f0-a35b-eff13bc0b034 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:22.824874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b218-1452-45f0-a35b-eff13bc0b034 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:22.826283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:22.831356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:22.831642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:22.831916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:22.876483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:22.883318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG passlib.handlers.bcrypt [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81629) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 17:43:22.883714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG passlib.handlers.bcrypt [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81629) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 17:43:22.934878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:22.934878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:23.035527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:23.147327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.172406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.251789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0e1c4-5600-4fac-9f59-59e97920c1a3 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.285206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.285885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.286399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.297352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:23.306831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:23.307963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:23.309534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:23.311095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.313765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.394473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.411007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92157bd7-5930-4379-a5a2-2bc282e3ea7c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.412490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aa38-b6fa-42d3-92f4-3f98efc9325a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.413252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.448018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.448620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.448894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.449164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.449275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.449877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:23.450025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.450177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.450307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.450577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.451673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.463457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:23.468955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.518745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.520301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.568234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835609-fb07-40ba-aa57-f49ca5c326d6 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.602044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.603244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.603760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.604093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.605243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.606707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.608313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 9/16] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:23.613915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.618334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 8/17] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:23.624491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.627408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.635902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.720685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5225f36-3ba5-492f-8e77-7b73a0548a5b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.722072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d170-767d-4df9-85e6-d24dc75b47ee None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.754362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.755017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.755295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.755563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.756658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.757533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.758095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.758391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.758674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.759109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.759695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:23.765359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.778064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.779606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:43:23.798663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:23.799744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:43:23.801115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:43:23.801115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:43:23.801115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:23.801115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:23.805392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:23.846716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.860805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:23.865431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ad78b-77cd-40f7-b3c9-d4d050d45b78 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.898925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.900123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.900410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.900679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.901403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.domain.id=default, user.id=d383e5f449b94c0eb3484442f9ddde97) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:23.901706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.905726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40657eb2-d9ac-4614-b005-dd42b4840186 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.906434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e709a-2cde-4619-bd15-45f27c7958fe None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:23.914249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/role_assignments?user.id=d383e5f449b94c0eb3484442f9ddde97&scope.domain.id=default&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:23.943157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:23.943791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:23.944101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:23.944375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:23.945040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:23.945345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:23.947236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4972bf-d3ff-4ba0-9a24-6abe635dc061 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:23.967006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:26.049116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01b7-8ef5-4643-90ba-ac6efc921a54 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.049618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01b7-8ef5-4643-90ba-ac6efc921a54 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.049692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c01b7-8ef5-4643-90ba-ac6efc921a54 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.051073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:26.068413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307f8e-3dca-4613-b724-8af1a1a5aa57 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.068893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307f8e-3dca-4613-b724-8af1a1a5aa57 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.068999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307f8e-3dca-4613-b724-8af1a1a5aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.096273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6c307f8e-3dca-4613-b724-8af1a1a5aa57 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:26.097483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6c307f8e-3dca-4613-b724-8af1a1a5aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:26.189235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:26.327469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e5004-ec2d-4b62-a526-ffd70d0db6e3 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.327818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e5004-ec2d-4b62-a526-ffd70d0db6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.328026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e5004-ec2d-4b62-a526-ffd70d0db6e3 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.329566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:26.334583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cd74-8d00-4c1f-a114-61cf7615f1d7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.334969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cd74-8d00-4c1f-a114-61cf7615f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.335248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cd74-8d00-4c1f-a114-61cf7615f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.362670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1ef9cd74-8d00-4c1f-a114-61cf7615f1d7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:26.363890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1ef9cd74-8d00-4c1f-a114-61cf7615f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:26.418968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:26.452273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 12/25] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:26.467507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77d67-3278-4e11-9b32-851947947bba None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.467804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77d67-3278-4e11-9b32-851947947bba None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.468064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77d67-3278-4e11-9b32-851947947bba None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.469579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 14/26] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:26.481034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.481326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.481600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.511808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:26.513034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:26.596372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:26.725546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77d67-3278-4e11-9b32-851947947bba None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:26.875694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77d67-3278-4e11-9b32-851947947bba None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:26.908020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:26.925681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:26.926331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.926610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.926911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.949747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-24f0dcb8-b0e3-4d3e-a0cb-d933e16b9f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:26.956826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:26.957724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 15/28] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:26.958485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0172-5343-4f8e-9638-10cfbae3ef33 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:26.959215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0172-5343-4f8e-9638-10cfbae3ef33 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:26.959215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0172-5343-4f8e-9638-10cfbae3ef33 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:26.959415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 16/29] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:26.967047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0172-5343-4f8e-9638-10cfbae3ef33 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:26.972443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.106950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ca609-3db1-45f9-b0e5-85ddb9ee3897 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.117065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.130374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0172-5343-4f8e-9638-10cfbae3ef33 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.156240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.156976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.157585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.157944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.172154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.172379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.173234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.173723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.174026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.174449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.175358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:27.175908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.177803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da975b-7d76-4a30-836b-ab9575597607 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.188033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 17/30] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:27.189475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.190028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.190517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:43:27.196076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:27.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:43:27.198139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:43:27.198139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:43:27.198139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:27.198139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 14/31] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:43:27.198139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.218171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:27.219718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:27.296771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.306029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 18/32] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:27.306925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.319324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30847f22-89d0-4ca8-b363-d6a989484bcb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.359431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.360418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.360943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.361472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.362339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.364082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.429257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eed5d-505d-49aa-8e8a-82aeb6ea5aaa None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.477435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.478690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.479319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.479797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.482089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.485700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.488772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 19/33] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:27 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:27.490809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.572623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.608380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 15/34] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Sep 1 17:43:27 2022] POST /identity/v3/roles => generated 219 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:27.609875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.618704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d760-65fd-4306-92df-207bdd224750 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.633371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.712292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.712863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.713133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.713403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.714631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:27.714631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.715962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.736841 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2beee-3433-4049-9773-fe9179bf22cb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.756303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 20/35] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:27.757232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.779147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.780270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.780757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.781243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.783097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.785113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.787162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 16/36] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:27.788359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:27.893405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.908021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064a8-220e-4305-9dcf-8200e1080058 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.908891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d725a-f2bb-49af-9c0f-6905c1d4f703 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:27.935646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:27.948477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.949127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.949443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:27.949562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.949788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.950067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:27.950352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:27.950498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.950650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:27.951331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:27.951935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129d0b5-ffe5-458b-89c5-46829f66bd80 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:27.952797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:28.074298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 17/37] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:43:27 2022] POST /identity/v3/projects => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:28.074298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:28.146931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 21/38] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Sep 1 17:43:27 2022] POST /identity/v3/roles => generated 225 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:28.148584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94251-a574-458d-857a-7a9bf84a9ec0 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.148882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94251-a574-458d-857a-7a9bf84a9ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.149168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94251-a574-458d-857a-7a9bf84a9ec0 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.150627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 22/39] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:28.156716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74c29-2ba9-4385-9b7f-1309eac029d1 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.157000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74c29-2ba9-4385-9b7f-1309eac029d1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.157284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74c29-2ba9-4385-9b7f-1309eac029d1 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.159104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 23/40] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:28.160385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.160672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.160950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.183392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:28.185502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:28.215884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c08f-2497-4873-ae91-956e4d5cb823 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:28.260577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:28.261635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.262169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.262643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] PATH_INFO: `/v3/domains/default/users/d383e5f449b94c0eb3484442f9ddde97/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.265496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d383e5f449b94c0eb3484442f9ddde97, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:28.267414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977de81-6b46-471b-bf82-ff8bfb9716b6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:28.354402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:28.359581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 18/41] 10.222.0.58 () {58 vars in 1361 bytes} [Thu Sep 1 17:43:28 2022] PUT /identity/v3/domains/default/users/d383e5f449b94c0eb3484442f9ddde97/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:28.360726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.361124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.361397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.383930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:28.385539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:28.401617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 24/42] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:28.464307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 19/43] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:28.676883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:28.730353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:28.791264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2c64-2c6b-4c1d-a436-fcf395dc6e25 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:28.808155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:28.830419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:28.831066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.831346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.831617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.832298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:28.833819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c2847-1a68-4256-816f-9222d7813ec2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:28.851735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243a50-1b8b-40f5-90bf-cf50ec35e8e1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:28.879711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:28.888353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:28.888985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:28.889267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:28.889537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:28.890636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:28.892113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:28.893856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 20/44] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:28.899071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:28.940351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 25/45] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Sep 1 17:43:28 2022] POST /identity/v3/roles => generated 223 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:29.023193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122ccc-40c2-4632-97dc-80a848d478c5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:29.059407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:29.060028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:29.060304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:29.060570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:29.061237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:29.062689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbf8dd-3f94-4943-a346-1b3926b454fc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:29.137660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 21/46] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:43:28 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:43:30.303816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd8fb-568d-4dc5-858d-fa3245980df4 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:30.304315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd8fb-568d-4dc5-858d-fa3245980df4 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:30.304425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd8fb-568d-4dc5-858d-fa3245980df4 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:30.306461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 26/47] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:30.311779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:30.312179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:30.312341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:30.330112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:30.331333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:30.375846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:30.398274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:30.674795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd8fb-568d-4dc5-858d-fa3245980df4 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:30.777332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd8fb-568d-4dc5-858d-fa3245980df4 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:30.812135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:30.812760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:30.813047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:30.813321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:30.823333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-b9682eb7-7ad1-4057-b94d-9b493852ae64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:30.828331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:30.829251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:30.830010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 27/49] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:30.835240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.052957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b78c84-06d4-4ab7-bd67-1067fcca8685 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.083234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726032da-3b7b-4dfa-b742-9ef96289c4dd None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.083637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726032da-3b7b-4dfa-b742-9ef96289c4dd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.083920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726032da-3b7b-4dfa-b742-9ef96289c4dd None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.085263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 28/50] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:31.087629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.088336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.088617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.088888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.089569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:31.089851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.090877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.091165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.091257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.091439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.103132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 23/51] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:31.108503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.109389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:31.110589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:31.138307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:31.151004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:31.177750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 29/52] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:31.209211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d338f-b0cc-42bf-ae6a-7444428d2efb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.242127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.242700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.243014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.243461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.244571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.246044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.247666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 24/53] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:31 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:31.253239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.355204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dd0de-fa90-4375-92b6-3786f82fbfb8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.389262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.389886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.390169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.390443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.391584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.393033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.394607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 30/54] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:31.401497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.445540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.477148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:31.501355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5636-b2ef-4d3d-9daa-164a78c77fa1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.510974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:31.535535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.536150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.536438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.536711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.537441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.domain.id=default, user.id=d383e5f449b94c0eb3484442f9ddde97) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:31.537755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.539247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.547410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1850b-58fc-4264-899a-01aab91f5742 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.548351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 25/55] 10.222.0.58 () {56 vars in 1322 bytes} [Thu Sep 1 17:43:31 2022] GET /identity/v3/role_assignments?user.id=d383e5f449b94c0eb3484442f9ddde97&scope.domain.id=default&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:31.585097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.585743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.586024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.586299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.587895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.589382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ed1ab-f7bd-4d40-9d67-06e17f849d4d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.591061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 31/56] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:31.597083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:31.703239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2d1e-f74b-467a-86d5-23cd4ccb5999 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:31.746718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:31.747356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:31.747644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:31.747963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:31.748620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:31.750064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0fa8-e024-4a8e-a103-10e748ab8f75 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:31.816114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 26/57] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Sep 1 17:43:31 2022] POST /identity/v3/projects => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:33.750215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af553ef-0c35-41a5-985e-fd2fa5bea32d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:33.750792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af553ef-0c35-41a5-985e-fd2fa5bea32d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:33.750792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af553ef-0c35-41a5-985e-fd2fa5bea32d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:33.752140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 32/58] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:33.757250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:33.757616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:33.760284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:33.776262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:33.777466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:33.794946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:33.842627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 27/59] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:34.120018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af553ef-0c35-41a5-985e-fd2fa5bea32d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:34.225967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:34.229742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af553ef-0c35-41a5-985e-fd2fa5bea32d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:34.266849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:34.267654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:34.267984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:34.268468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:34.269983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:34.271484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67573910-e7a1-4583-b503-c833768a0436 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:34.273087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 33/60] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:34.279249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:34.376168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eda03-a7b6-4daa-8076-1d80f135af69 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:34.409291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:34.409893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:34.410175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:34.410450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:34.411149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:34.412609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7148-8a6f-45f9-8c6d-6e40c4b970cb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:34.512236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 28/61] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:43:34 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:43:37.501107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b4de-3522-483c-a4cf-554f5a3a0426 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.538709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b4de-3522-483c-a4cf-554f5a3a0426 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.538709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b4de-3522-483c-a4cf-554f5a3a0426 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.538709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 34/62] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:37.539009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106ffc5-abd1-4e84-ae86-5eaeffe30dc3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.539009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106ffc5-abd1-4e84-ae86-5eaeffe30dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.539009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106ffc5-abd1-4e84-ae86-5eaeffe30dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.551028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0106ffc5-abd1-4e84-ae86-5eaeffe30dc3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:37.552509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0106ffc5-abd1-4e84-ae86-5eaeffe30dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:37.560064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.641627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 29/63] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:37.771964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a88c8-c080-40c3-9a9b-7af2ba4725e2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.771964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a88c8-c080-40c3-9a9b-7af2ba4725e2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.771964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a88c8-c080-40c3-9a9b-7af2ba4725e2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.771964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 35/64] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:37.777919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.778160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.778417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.801918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab4fa-c33f-4828-82dc-11f4e9c8cba6 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.802919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab4fa-c33f-4828-82dc-11f4e9c8cba6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.803413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab4fa-c33f-4828-82dc-11f4e9c8cba6 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.805229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 36/65] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:37.810201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:37.810636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:37.810962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:37.811245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:37.811450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:37.844055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:37.845292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:37.908053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 30/66] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:37.956251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 37/67] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:37.958950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.052654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.085965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada290-385f-4e96-9944-50f0ca6362c8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.132487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.133126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.133407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.134213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.152404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-94947ff9-1492-406b-b4a7-c74ce10d0103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:38.159354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:38.160252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:38.161075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 31/68] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:38.171838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.233060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4ae9-51c8-4cf4-a695-d8bdda9a69b4 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.233387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4ae9-51c8-4cf4-a695-d8bdda9a69b4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.233628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4ae9-51c8-4cf4-a695-d8bdda9a69b4 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.235256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 32/69] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:38.240222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.240515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.240777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.283859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:38.285418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:38.336134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.341073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb9c9-0c67-45ef-8c97-65a693b67a44 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.365214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 33/70] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:38.366537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.378134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.378809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.379094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.379372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.380047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:38.380366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:38.381755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:38.397368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 38/71] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:38.397368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.437455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.483408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df0452-4026-4895-a753-ad9fb4c40ecc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.502609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988d208-fc59-422a-b017-6143f11361ae None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.519317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.519956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.520243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.520532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.532363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-6c80046b-1ca9-4262-a09e-0cb8974d74df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:38.537721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:38.538598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 34/72] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:38.540273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26e5-7ab3-49f3-876a-2a49b643af99 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.540969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26e5-7ab3-49f3-876a-2a49b643af99 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.540969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26e5-7ab3-49f3-876a-2a49b643af99 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.541847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 35/73] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:38.542548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a26e5-7ab3-49f3-876a-2a49b643af99 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.545066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.545712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.545997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.546275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.557443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:38.563173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:38.564071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:38.564854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 39/74] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:38.565508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.595194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.655348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a26e5-7ab3-49f3-876a-2a49b643af99 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.677205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.677351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954e19-bd7e-4894-947c-bfe737532223 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.691149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.691781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.692059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.692333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.708226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:38.709699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fcb88-a072-41b0-86ab-70e972629029 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:38.711335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 36/75] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:38.713411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.714026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.714309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.714584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.715291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:38.715602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:38.716027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.716317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.716693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.716992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:38.725542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 40/76] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:38.726203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.735527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:38.736732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:38.803476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 37/77] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:38.804304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.809655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.827940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219a086-21ba-4ee6-b51a-c53bbb2dfd1e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.866176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.866711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.867026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.867303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.868552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:38.868865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:38.870322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:38.883577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 41/78] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:38.883577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.913678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65931f9-c273-40ef-a8fc-83614e618fb4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:38.923769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:38.952843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:38.953721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:38.953721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:38.953997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:38.964604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:38.969454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:38.970311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 38/79] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:38.975494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:38.999648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae926ba-a35c-4642-a524-246e07c75356 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.037272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.037985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.038268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.038547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.053931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.078786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df840-a36d-4b3c-9848-eefa152062cd None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.109369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.110868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.111718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.112347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.112634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.112908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.114046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.115521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.117164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 39/80] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.118402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.152633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.214117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:39.215228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.216714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d58b-e8d5-4ee3-876d-57ae58c2bf68 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.250855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.251485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.251772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.252048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.253189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.254629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.256242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 40/82] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.257003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.264299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.320340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fb83-a3a8-4245-a09f-3ff1343b2c7c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.355487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.356098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.356386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.356689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.357360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:39.357665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.359091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.363982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fbff-e6f0-48a9-bda4-434414456409 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.367001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.367307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 43/83] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.368620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.402076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.403018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.403308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.403580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.404703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.406136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.407751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 41/84] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.408511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.476075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1974a3-b9a2-4c0c-8063-bef6696ae01b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.483374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.507744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d6f6-dedb-40b0-8fff-daa65c0bda62 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.510222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.511610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.511898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.512183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.542642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.543297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.543578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.543849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.544996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.546441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.548110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 42/85] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.548926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.580921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.582406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.590656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.653988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a9bf6-93f9-4403-9006-cc49aa3d8b14 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.690889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 44/86] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:39.691952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.700376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.704204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.704815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.705095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.705370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.773921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.776769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.802306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f61e-90b4-4a14-b79c-0df969bb6fc9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:39.823958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.847209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:39.847863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:39.848148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:39.848421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:39.849550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:39.851028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:39.853184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 45/87] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:39.853919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.884865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:39.885723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:39.933540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:39.976167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3add-6d21-4f0b-9a19-d016e1fbf77c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.000016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d9911-f3e4-4cec-9963-0cbb5f62b96e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.025473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.026178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.026443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.026850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.027443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.029018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.046380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.047041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.047320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.047594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.048338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:40.048678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.050129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.058497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 44/89] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:39 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:40.072086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.072086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:40.119794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 46/90] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:43:39 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:40.121874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.197333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e595a1-8d35-49b7-b25f-115af33bbb72 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.257416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.258075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.258354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.259490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.260387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.261867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.265200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 45/91] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:40.266056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.312726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a254df-48ed-4dea-aee0-897a6af66b2e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.357661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:40.366401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.370118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.370118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.370118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.379078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:40.422710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9906d-a19f-4e6b-acae-29d82a1fa345 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.482646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.483911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.484200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.484572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.484851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.485124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.486765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.489459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.491367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 46/92] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:40.493590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.646981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73965a3c-8201-4cc5-9531-b8fd9c5c4d7b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.686814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.687440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.687723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.687997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:40.688738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d383e5f449b94c0eb3484442f9ddde97) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:40.689046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:40.691767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:40.699444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 47/93] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/role_assignments?user.id=d383e5f449b94c0eb3484442f9ddde97&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:40.699905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.705554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 47/94] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:40.709714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:40.716488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:40.780104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:40.944702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c44-309c-4820-b01c-8465fe2e3111 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.996167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfcf1d-41b0-44ba-9a94-d9d4449f0aff None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:40.997978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:40.999377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:40.999662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:40.999957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] PATH_INFO: `/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:41.001322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] RBAC: Authorizing `identity:get_project(project_id=a7bda86a3d0c45249195ce5e20d34a3e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:41.007688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:41.007688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 48/95] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:41.018543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:41.124891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:41.125611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:41.125994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:41.126373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:41.127274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:41.127690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:41.129263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1053a5-3fc7-4bae-943a-c5b638f4cb10 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:41.144904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 48/96] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:40 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=af51edba370344dcadca2bd3e932b609 => generated 259 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:41.145298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:41.150885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b30b-65cd-45b7-a96c-c3293d1a00aa None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:41.190598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:41.191308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:41.191602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:41.191884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:41.192630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=a7bda86a3d0c45249195ce5e20d34a3e, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:41.192944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:41.194645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e716c-0772-4e27-bfee-47a6bb34c3ab None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:41.201288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 49/97] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:41 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=a7bda86a3d0c45249195ce5e20d34a3e&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:42.556970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6e19-b6e6-4f3b-a0c3-e357c73290ee None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:42.557509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6e19-b6e6-4f3b-a0c3-e357c73290ee None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:42.557509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b6e19-b6e6-4f3b-a0c3-e357c73290ee None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:42.559309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 49/98] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:42.572612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:42.573053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:42.573234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:42.595108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:42.596333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:42.674430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 50/99] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:43.017330 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b6e19-b6e6-4f3b-a0c3-e357c73290ee None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:43.104025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:43.143458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b6e19-b6e6-4f3b-a0c3-e357c73290ee None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:43.188561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:43.189206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.189487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.189762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.211803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:43.217724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:43.218612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:43.220251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 50/100] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:43.224653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:43.330460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:43.340995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0467-616b-4607-9111-31c50a295df7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:43.378677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:43.379324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.379608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.379905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.380651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:43.380956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:43.382389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea9e8a-e0e1-4707-ba5f-74a20b6f571b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:43.392235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 51/101] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:43.397878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:43.525670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b4652-3e82-4f40-8511-7ef5c31c87e2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:43.554971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:43.555147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b2d1-bef6-4f29-86bc-07f50200f446 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.555401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b2d1-bef6-4f29-86bc-07f50200f446 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.556194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b2d1-bef6-4f29-86bc-07f50200f446 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.558072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 52/102] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:43.564355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49395e7b-0ac0-47ac-ae61-a846f7daf72c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.565033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49395e7b-0ac0-47ac-ae61-a846f7daf72c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.565472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49395e7b-0ac0-47ac-ae61-a846f7daf72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.566132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:43.571086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.571086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.571086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.571086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:43.571086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:43.571898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 51/103] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:43 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:43.586269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:43.593411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-49395e7b-0ac0-47ac-ae61-a846f7daf72c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:43.595349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-49395e7b-0ac0-47ac-ae61-a846f7daf72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:43.668552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 53/104] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:43.676376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f623cc-3e39-45b2-a03e-88c90028afcb None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.676906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f623cc-3e39-45b2-a03e-88c90028afcb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.677374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f623cc-3e39-45b2-a03e-88c90028afcb None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.678931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 54/105] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:43.686287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644123-cbe4-4a64-816c-6c501ac5206c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.686928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644123-cbe4-4a64-816c-6c501ac5206c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.687462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644123-cbe4-4a64-816c-6c501ac5206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.710747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dba23-8198-4812-b09e-47a7febc8c63 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:43.718413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c0644123-cbe4-4a64-816c-6c501ac5206c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:43.719984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c0644123-cbe4-4a64-816c-6c501ac5206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:43.750155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:43.750824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.751112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.751544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.755518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:43.757307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:43.759643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 52/106] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:43 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:43.765465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:43.826449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:43.829838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882be02-c974-4415-aa94-633c168d7cfa None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.831801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882be02-c974-4415-aa94-633c168d7cfa None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.832282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882be02-c974-4415-aa94-633c168d7cfa None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.834118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 56/108] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:43.841439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be671-0a72-4607-bf04-3ccde568e182 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:43.842162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be671-0a72-4607-bf04-3ccde568e182 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:43.843824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be671-0a72-4607-bf04-3ccde568e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:43.893040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-901be671-0a72-4607-bf04-3ccde568e182 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:43.896034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-901be671-0a72-4607-bf04-3ccde568e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:43.920520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:43.944388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:44.046224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1defb73-f952-46a2-83a0-f4cf0421c3a1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.064255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 57/109] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:44.101436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e602c08-142f-4678-a071-556dd960270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.102030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602c08-142f-4678-a071-556dd960270d None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.102641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602c08-142f-4678-a071-556dd960270d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.103103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602c08-142f-4678-a071-556dd960270d None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d5742535bacd4069bdbcaa747219e771/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.104998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e602c08-142f-4678-a071-556dd960270d None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, user_id=d5742535bacd4069bdbcaa747219e771, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:44.106519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e602c08-142f-4678-a071-556dd960270d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:44.171270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df7722-9b89-4238-9095-e199da7e24ef None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.171600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df7722-9b89-4238-9095-e199da7e24ef None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.171929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df7722-9b89-4238-9095-e199da7e24ef None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.173364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 58/110] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:44.175263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df7722-9b89-4238-9095-e199da7e24ef None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.178964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 53/111] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:43 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d5742535bacd4069bdbcaa747219e771/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:43:44.183104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.183466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.183787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.208184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:44.209606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:44.297298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 54/112] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:44.298312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.306862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df7722-9b89-4238-9095-e199da7e24ef None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.349402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.350151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.350435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.350710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.359199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:44.360724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:44.362686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 59/113] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:44.369365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:44.371545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.401514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:44.467999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e08a-b473-4f9b-94a2-068c781cfa53 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.509739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.510486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.510798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.511076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.522370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-199eb7a9-ad76-4c2d-8426-9a6e8c2cf972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:44.527425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:44.529478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 55/114] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:44.531472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd0f5-a34c-4921-a446-89603e405574 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.533164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd0f5-a34c-4921-a446-89603e405574 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.533164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd0f5-a34c-4921-a446-89603e405574 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.538750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 56/115] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:44.538750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdd0f5-a34c-4921-a446-89603e405574 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.542806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ca9b-c65e-4992-abc9-38cdc868403b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.584310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.584976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.585258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.585638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.586444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:44.588535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:44.648216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdd0f5-a34c-4921-a446-89603e405574 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.663817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:44.679815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 60/116] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:43:44 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:43:44.681331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.696732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.698169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.698677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.699568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.717380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8eb1fe3c-4932-4ed0-8819-62a78d0582af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:44.725296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:44.726232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:44.729340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 57/117] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:44.732779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.733069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.744132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.762603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:44.764088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:44.810519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:44.855354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fbd85-b32f-47e5-a606-fc9cbc5dce91 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.862871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 58/118] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:44.863762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.895853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:44.897012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:44.897596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:44.898401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:44.899850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:44.900461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:44.902281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:44.911924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 61/119] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:44.913201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:44.989702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aa880-16d3-467a-a5e2-33f422dcc515 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:44.991985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.032239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc41a-28d2-4ed3-bb84-2c6c1be8e686 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.069115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.070161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.070643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.071895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.072998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:45.073593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.078934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.080242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.082333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.083029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.083316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.083591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.098512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 62/120] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.099737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.114667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:45.121073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:45.122046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:45.122875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 59/121] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:45.123510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.257414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933dba-4228-4440-ac6d-f5176ac3c59f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.281480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a405-22dd-44e7-b12b-2a2208d66664 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.294916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.295643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.296195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] PATH_INFO: `/v3/users/9adfdd11948b4ce0b772179374a07cd2` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.311339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] RBAC: Authorizing `identity:get_user(user_id=9adfdd11948b4ce0b772179374a07cd2)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.312816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.314874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 60/122] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/users/9adfdd11948b4ce0b772179374a07cd2 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.315757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.326152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.326840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.327125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.327400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.328620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.330504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.333115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 63/123] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.333965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.348952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.402527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.432617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d7f8-8694-4046-b2a9-77b85dafbc47 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.455991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120e0d-8bf7-408c-8bd2-154b59e18752 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.479919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.480805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.481239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.481649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.482459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:45.482953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.484533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.493345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 61/124] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.494158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.503605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.505067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.505526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.506438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.520903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:45.528248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:45.529165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 64/125] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:45.534876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.604224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.621698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef5a87-badd-43c5-9b73-fdd54aa56e69 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.662230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.662980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.663176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.663454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.674064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b089b-6897-4c73-8d54-554b9b353a01 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.693067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.713946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.714946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.715449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.715988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.718476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.720235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.722188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 65/126] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.723312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.752437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.753912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.899230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:45.901306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ddd8-3afb-4730-badb-68346378ab1e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:45.902711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 62/127] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:45.911703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:45.950823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:45.952457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:45.952943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:45.953633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:45.955691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:45.957366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:45.960189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 66/128] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:45.961148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.044372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999284bb-6e77-4c3e-893f-6fc4072d161c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.045560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.089867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805951-c187-4178-945f-305c68a88c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.091361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805951-c187-4178-945f-305c68a88c53 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.091820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805951-c187-4178-945f-305c68a88c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.092521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805951-c187-4178-945f-305c68a88c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.093341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19805951-c187-4178-945f-305c68a88c53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:46.094035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19805951-c187-4178-945f-305c68a88c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.096360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19805951-c187-4178-945f-305c68a88c53 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.103893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283e86c-1eef-49d4-ad0e-9ef1903f11d9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.109253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 63/129] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:43:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.110949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805951-c187-4178-945f-305c68a88c53 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.156085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.156889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.157234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.157606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d383e5f449b94c0eb3484442f9ddde97/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.159699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, user_id=d383e5f449b94c0eb3484442f9ddde97, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.161361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.164772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.223020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805951-c187-4178-945f-305c68a88c53 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.262310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 67/130] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:45 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d383e5f449b94c0eb3484442f9ddde97/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:46.262310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.269664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.270404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.270780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.271061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.272302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.275296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.280900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 64/131] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:46 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.281790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.458269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c8ea-c5d1-4f9b-9bc5-4c2ee1414451 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.474347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.475734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac62bb4-52c6-43e7-99c2-a7443de0cf0a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.497871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.517453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf603-3580-476c-aee8-133287879dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.518101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf603-3580-476c-aee8-133287879dec None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.518387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf603-3580-476c-aee8-133287879dec None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.518676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bf603-3580-476c-aee8-133287879dec None admin] PATH_INFO: `/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.519884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bf603-3580-476c-aee8-133287879dec None admin] RBAC: Authorizing `identity:get_project(project_id=a7bda86a3d0c45249195ce5e20d34a3e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.521366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bf603-3580-476c-aee8-133287879dec None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.523301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 68/132] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:46 2022] GET /identity/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.542771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf603-3580-476c-aee8-133287879dec None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.542897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.542897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.542897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.542897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835715-4caa-427c-a15c-dd826444b855 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 65/133] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:46 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1143-c5e9-46a2-bc0d-52ac76d397d9 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1143-c5e9-46a2-bc0d-52ac76d397d9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.543159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1143-c5e9-46a2-bc0d-52ac76d397d9 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.543490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 66/134] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:46.543490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1143-c5e9-46a2-bc0d-52ac76d397d9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.650763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bf603-3580-476c-aee8-133287879dec None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.665372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1143-c5e9-46a2-bc0d-52ac76d397d9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.696166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.698018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.698583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.699150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.700254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=9adfdd11948b4ce0b772179374a07cd2) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:46.700940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.702132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.702958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.703127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.703354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.703699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] PATH_INFO: `/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e/users/d5742535bacd4069bdbcaa747219e771/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.705975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] RBAC: Authorizing `identity:create_grant(project_id=a7bda86a3d0c45249195ce5e20d34a3e, user_id=d5742535bacd4069bdbcaa747219e771, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.707682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c270128-4d84-442b-a4f1-759fe97e71bd None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.710676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 69/135] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:46 2022] GET /identity/v3/role_assignments?user.id=9adfdd11948b4ce0b772179374a07cd2&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=b347c7ec85c44d84b60d838028750f8b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.713227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.775321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:46.848380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fcddb-d025-4313-a4ea-fea611f7cb12 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:46.869356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 67/136] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:46 2022] PUT /identity/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e/users/d5742535bacd4069bdbcaa747219e771/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:46.870397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a8d0-795e-4e26-81e1-1c64cbed5443 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.870761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a8d0-795e-4e26-81e1-1c64cbed5443 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.870984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00a8d0-795e-4e26-81e1-1c64cbed5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.890123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:46.890795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:46.891080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:46.891355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:46.892538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:46.894150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:46.896185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 70/137] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:46 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:46.902565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:46.904061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3d00a8d0-795e-4e26-81e1-1c64cbed5443 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:46.905383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3d00a8d0-795e-4e26-81e1-1c64cbed5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:47.007216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:47.049455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 68/138] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:47.050904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089253-0a2d-42e2-b57d-4232a764b426 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:47.051195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089253-0a2d-42e2-b57d-4232a764b426 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:47.051473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73089253-0a2d-42e2-b57d-4232a764b426 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:47.052858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 69/139] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:47.059485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:47.059804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:47.060090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:47.079923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:47.081103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:47.096091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bb7fa-2d11-4bf4-a149-fd560fb02951 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:47.118802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:47.158511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:47.159195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:47.159473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:47.159743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d5742535bacd4069bdbcaa747219e771/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:47.163055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, user_id=d5742535bacd4069bdbcaa747219e771, role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:47.164529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:47.191374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 70/140] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:47.242256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 71/141] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:46 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/d5742535bacd4069bdbcaa747219e771/roles/af51edba370344dcadca2bd3e932b609 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:47.432178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:47.510526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:47.577362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad030f89-60fc-4f72-9370-bcaa0e056388 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:47.579318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:47.635462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:47.641189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:47.641724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:47.642195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:47.661200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:47.668140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:47.669479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:47.670309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 71/142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:43:47.677959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:47.691152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f68d1-c320-4aef-82fb-d000328b81f2 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:47.744835 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:47.745474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:47.745894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:47.746168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:47.747530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:47.753425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:47.753425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 72/143] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:47.756945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:47.833438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:47.922768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa8a25-89f4-4f28-9837-436f765ce277 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:47.974607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0c6b-dec9-4719-a31d-ae5047f43473 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:48.000780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:48.001407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:48.001686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:48.001955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:48.002670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:48.002998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:48.004376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:48.021376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 72/144] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:48.032335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:48.040567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:48.040800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:48.041087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:48.041312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:48.042026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:48.043515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:48.086249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:48.145723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 73/145] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:43:47 2022] POST /identity/v3/users => generated 283 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:48.220910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635f54-af6b-4242-b154-9c021ffff48b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:48.276749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:48.277802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:48.278313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:48.278842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:48.280331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:48.282063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:48.284030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 73/146] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:48 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:48.290419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:48.424605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:48.432582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c634a-0539-4136-8b20-946cc5028ea5 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:48.479233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:48.480248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:48.480728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:48.481205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:48.575361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:48.577201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:48.675456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:48.686225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 74/147] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:48.693548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:48.826132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:48.835454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2999b-ef11-47c6-9b1c-7f02c2122ede None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:48.880829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:48.881574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:48.881943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:48.882064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:48.883191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:48.885288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312f9e9-ea11-49b7-95b9-0a0e62d37548 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:48.887314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 74/148] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:48 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:48.894803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:49.044748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357863-d373-4c7a-88f0-580fefb5e157 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:49.097807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:49.097807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.097807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.097807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.098169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:49.098169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:49.098169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d234c2-a070-45a9-afb1-9d67255e4e83 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:49.102783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 75/149] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:48 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:49.207351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49803-4b21-4408-ad01-d053ff5d2e50 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.207669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49803-4b21-4408-ad01-d053ff5d2e50 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.207906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49803-4b21-4408-ad01-d053ff5d2e50 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.209285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 75/150] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:49.224585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dada5-e1a1-4954-a1c1-1254f2046cf2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.224890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dada5-e1a1-4954-a1c1-1254f2046cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.225144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dada5-e1a1-4954-a1c1-1254f2046cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.246306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ba9dada5-e1a1-4954-a1c1-1254f2046cf2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:49.247552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ba9dada5-e1a1-4954-a1c1-1254f2046cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:49.318820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:49.332350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 76/151] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:49.493317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ac183-d27b-416d-b18d-7c83382e06ed None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.493562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ac183-d27b-416d-b18d-7c83382e06ed None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.493767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ac183-d27b-416d-b18d-7c83382e06ed None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.495319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 76/152] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:49.504904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bd2-9091-43f3-a65c-42477e98cdcf None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.505270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bd2-9091-43f3-a65c-42477e98cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.505644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bd2-9091-43f3-a65c-42477e98cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.526929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-551d6bd2-9091-43f3-a65c-42477e98cdcf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:49.528125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-551d6bd2-9091-43f3-a65c-42477e98cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:49.608663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 77/153] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:49.682582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ac183-d27b-416d-b18d-7c83382e06ed None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:49.799803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ac183-d27b-416d-b18d-7c83382e06ed None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:49.843729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:49.844377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.844698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.844975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.859933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:49.861416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a45c8-fcd8-4422-b2bc-2047d562f174 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.861704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a45c8-fcd8-4422-b2bc-2047d562f174 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.861974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a45c8-fcd8-4422-b2bc-2047d562f174 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.863501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 78/154] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:49.868555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:49.869428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:49.870214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:49.871723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:49.871723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:49.871723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:49.872055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 77/155] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:49.877303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:49.896965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:49.900690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:49.926234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.043050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 79/156] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:50.065641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce45e-fd7e-475a-b8fa-c9c7decd5194 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:50.103050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:50.103663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.103945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.104218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.104888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:50.105190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:50.106673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:50.115249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 78/157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:50.121437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:50.126342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:50.182763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.269973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd373ff-522e-4967-a40f-81a0a046dd83 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:50.315147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.329175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f70c1-53b5-40e9-b10a-14356bc65094 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:50.363749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:50.364449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.364737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.365011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.375565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:50.376227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.376514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.376794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] PATH_INFO: `/v3/users/d383e5f449b94c0eb3484442f9ddde97` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.378117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] RBAC: Authorizing `identity:get_user(user_id=d383e5f449b94c0eb3484442f9ddde97)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:50.379775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d54839-1883-4cc8-9f0c-69f1256694da None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:50.381729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 80/158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/users/d383e5f449b94c0eb3484442f9ddde97 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:50.382027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:50.382916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76f88-298b-4c4d-b82d-5d1b2b6c4aaa None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.383201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76f88-298b-4c4d-b82d-5d1b2b6c4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.384200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76f88-298b-4c4d-b82d-5d1b2b6c4aaa None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:50.388403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:50.389273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:50.390435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 79/159] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:43:50.391818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:50.395383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 81/160] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:50.401324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76f88-298b-4c4d-b82d-5d1b2b6c4aaa None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:50.530222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5e26-c9b9-48e2-9d90-d533960e4be3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:50.565595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:50.566225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.566509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.566806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.587615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.641582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:50.643175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dca9b-ade0-4235-b005-f9a950909d7f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:50.679401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76f88-298b-4c4d-b82d-5d1b2b6c4aaa None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:50.709919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.749167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 80/161] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:50.750851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.751233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.751455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:50.751650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:50.755901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:50.771224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 82/162] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:50.771692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:50.772074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:50.773072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:50.815076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:50.847841 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 81/163] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:50.855112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.034654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a6d2-9d97-42bb-9fcf-0ad5473faf8f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.068689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48e57d-bb5c-42d2-a14f-f98bbcf5ca97 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.090291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.090964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.091244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.091517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.092656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.094105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.095767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 82/164] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.096523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.139764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.155473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.156138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.156419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.156689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.195366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:51.201454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:51.202441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:51.203710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:51.204504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d036ad-b03b-46b0-b6b7-9154841d255f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.204583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 83/165] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:51.204583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.239202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.240143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.240556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.240837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] PATH_INFO: `/v3/users/9adfdd11948b4ce0b772179374a07cd2` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.242066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] RBAC: Authorizing `identity:get_user(user_id=9adfdd11948b4ce0b772179374a07cd2)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.244740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.246622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 83/166] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/users/9adfdd11948b4ce0b772179374a07cd2 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.247412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.327489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.357543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318cfa7-1529-4af0-bf2b-19a751927076 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.375081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.396676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.397203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.397480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.397748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.398432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:51.398750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.401000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.411086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 84/167] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.412044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.448414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d757e2-6b1a-43ad-bad1-9616d2d5cbfe None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.501235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.501855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.502130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.502403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.503517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d383e5f449b94c0eb3484442f9ddde97) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:51.503823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.505441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.512309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 84/168] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/role_assignments?user.id=d383e5f449b94c0eb3484442f9ddde97&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.513313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.628988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e2ed-c647-4c75-9fdb-b3dddd0fdae8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.659813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2d752-ddc1-4c21-b690-5ac549fcd436 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.662256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.702031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.702925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.703477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.704113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.716658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:51.719525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.720188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.720467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.720740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:51.721693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:51.722616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:51.723844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:51.724454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.724532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 85/169] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:51.724532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.724662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.725660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 85/170] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.731417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.813134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.843597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ebc3a-07d0-48d5-a16d-28fa60386bdc None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:51.882001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:51.882806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:51.883097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:51.883427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:51.884863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:51.886619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:51.889089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 86/171] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:51.889879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:51.931220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:51.973558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d575c90-5aca-4672-bfef-f2bdeffcc212 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.012487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ed87-7b1f-4d03-ba55-d59a6958d311 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.048403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.049092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.049372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.049642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/9adfdd11948b4ce0b772179374a07cd2/roles/b347c7ec85c44d84b60d838028750f8b` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.051781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, user_id=9adfdd11948b4ce0b772179374a07cd2, role_id=b347c7ec85c44d84b60d838028750f8b)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.053446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.053722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.054339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.054618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.054920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.056348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:52.056651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.058033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.068757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 87/172] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:52.069440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.118354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 86/173] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:51 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/users/9adfdd11948b4ce0b772179374a07cd2/roles/b347c7ec85c44d84b60d838028750f8b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:52.119207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.234909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.250225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3ce3-1ebe-4dcc-a135-2dfaa09bbfec None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.298954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.299581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.299859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.300130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.351093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.356763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6ff5-f056-4365-97a1-489a251f3ec5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.376666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.378385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c21a6-70f2-41b0-9fd4-8b3d8c875747 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.396450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.397096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.397374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.397645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] PATH_INFO: `/v3/users/d5742535bacd4069bdbcaa747219e771` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.399501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=d5742535bacd4069bdbcaa747219e771)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.401499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c05abe-74c6-48c5-b15f-8b7c065e8cc6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.403460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 87/174] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/users/d5742535bacd4069bdbcaa747219e771 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:52.405227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0886-d8d5-47b3-86ba-fa815afa10d3 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.405227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0886-d8d5-47b3-86ba-fa815afa10d3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.405227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0886-d8d5-47b3-86ba-fa815afa10d3 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.406377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 88/175] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:52.411618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0886-d8d5-47b3-86ba-fa815afa10d3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.491608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.501653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 88/176] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:52.505933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.506417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.516204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.526114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:52.527358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:52.550457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0886-d8d5-47b3-86ba-fa815afa10d3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.591053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.591864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.592145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.592417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.599236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 89/177] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:52.599916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.643687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.689554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.691530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8d7e8-af21-4b60-abe5-560770221835 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.735778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e9f8d-95fd-4bf8-bcda-1503d1db91a1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.761839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.773087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.773772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.774661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] PATH_INFO: `/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] RBAC: Authorizing `identity:get_project(project_id=a7bda86a3d0c45249195ce5e20d34a3e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f278e4-4096-49fa-8614-45b959058156 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 90/178] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/projects/a7bda86a3d0c45249195ce5e20d34a3e => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfa20-2a72-4f8d-b708-a14e114b0c81 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.781807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfa20-2a72-4f8d-b708-a14e114b0c81 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.782216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfa20-2a72-4f8d-b708-a14e114b0c81 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.782601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 91/179] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:52.783854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff353-2858-4a24-865a-ddbfdbd33792 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.784329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff353-2858-4a24-865a-ddbfdbd33792 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.785094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff353-2858-4a24-865a-ddbfdbd33792 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.786707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 92/180] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:52.787701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ff353-2858-4a24-865a-ddbfdbd33792 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.816471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 89/181] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:52.822756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec349a11-824a-41f0-b3ee-29ff377249af None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.823309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec349a11-824a-41f0-b3ee-29ff377249af None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.823724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec349a11-824a-41f0-b3ee-29ff377249af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.850010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ec349a11-824a-41f0-b3ee-29ff377249af None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:52.852744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ec349a11-824a-41f0-b3ee-29ff377249af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:52.907279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ff353-2858-4a24-865a-ddbfdbd33792 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:52.929407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:52.940032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 90/182] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:52.941755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.941755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.942103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.954213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:52.955098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:52.955663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:52.955940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:52.956667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=a7bda86a3d0c45249195ce5e20d34a3e, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:52.956970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:52.958414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:52.966189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 93/183] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=a7bda86a3d0c45249195ce5e20d34a3e&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:52.967086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:52.976086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:52.981908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:53.034564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.054839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 91/184] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:53.056018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.113168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0db688-dc13-4e0d-be73-cb0def1abf27 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.165806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab597-b890-4f83-89e8-b4bd6eefd552 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.172563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.173494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.174000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.174473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.178575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.181111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.183193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 94/185] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:52 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:53.189185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.194980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.204500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.205444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.210786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.210786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.218398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:53.223563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:53.224441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:53.225263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:53.228691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 92/186] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:53.234165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.369780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d854ba-8f74-4a24-94dc-75ae62a86d76 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.394849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150759d3-46dc-4907-a40a-78650e7d94df None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.417736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.434563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.439561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.439561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.439561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.439561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=d5742535bacd4069bdbcaa747219e771) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:53.439561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.439989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.439989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.439989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.439989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.440289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.440360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:53.440360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.440884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.449256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 95/187] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/role_assignments?user.id=d5742535bacd4069bdbcaa747219e771&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=af51edba370344dcadca2bd3e932b609 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:53.450523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.455041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 93/188] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:53.460230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.543865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.613866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e64d-747b-491c-a27a-3055622d4861 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.619396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db0f2-4884-4daa-9ecd-45be1fc801fe None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.658110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.659156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.659613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.660132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.660449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.661082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.661359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.661626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.662417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.664096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.670838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 96/189] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:53.671971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.679192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.681394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.688596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 94/190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:53.688596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.742109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.790784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b2d8e-fac5-45d4-9a52-9ef8c361518d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.800285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f2bb-a2cc-4688-9dc6-ca30328a3049 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.808673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:53.827850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.828480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.828759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.829031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.835610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:53.836213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:53.837108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:53.837382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:53.838092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:53.839596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:53.840593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:53.845965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:53.846831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:53.847634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 97/191] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:53.848280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.945174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 95/192] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:43:53 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:53.946662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:53.968081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c730fc4-9ff8-4501-b48a-9a4b70a4950e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:53.996941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.024796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.025471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.025752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.026026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.100971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f61f2-a753-44dc-8af3-03ea714a5821 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:54.127629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.129967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.141867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.142485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.142792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.143072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.143756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:54.144062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.145470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.155231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 96/193] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:54.162576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:54.189777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.262662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 98/194] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:54.267977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:54.282358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a63813-69e5-4815-9c2b-20e3b73de9aa None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:54.291748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.346064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.347677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.347677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.347677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.350144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.351053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.355732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 97/195] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:54 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:54.362355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:54.441228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14701e71-0723-4924-9f34-8285be4f5df7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:54.515248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.527088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.536545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.536545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.536545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.536545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.536828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c506afa-bb39-4cec-b41d-f84a1aa05027 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:54.536915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.541722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 99/196] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:54 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:54.548485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:54.640028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.641024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.641530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.641999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.663123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.674846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f07d-659d-4d44-9618-7b58bba524ab None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:54.725939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.728174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:54.728318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.728795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.729078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.729353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.730095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=a4ec6a338fae43c59700d3b0e62af1ef) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:54.730403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:54.734938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acce6-24ba-46f9-a271-f4f932e4177a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:54.746965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 100/197] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:54 2022] GET /identity/v3/role_assignments?user.id=a4ec6a338fae43c59700d3b0e62af1ef&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:54.748797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594aaa-18c9-4db7-9826-4e5f43e1b6af None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.749308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594aaa-18c9-4db7-9826-4e5f43e1b6af None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.749780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594aaa-18c9-4db7-9826-4e5f43e1b6af None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.754550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 101/198] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:54.763085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:54.763764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:54.764247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:54.812647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:54.822174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:54.982048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:54.996272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 98/199] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:55.007767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:55.015232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 102/200] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:55.117796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7175a-42d5-476f-ada3-de5ca56d5eea None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:55.158148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:55.158800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:55.159079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:55.159344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:55.160485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:55.161921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:55.163742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 99/201] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:55 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:55.170212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:55.293996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:55.322330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd61d4-f810-4e2a-a065-ab0ef2453d21 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:55.365493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:55.366469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:55.367007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:55.367479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:55.369009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=a4ec6a338fae43c59700d3b0e62af1ef) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:55.369518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:55.371261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:55.377559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 103/202] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:55 2022] GET /identity/v3/role_assignments?user.id=a4ec6a338fae43c59700d3b0e62af1ef&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=af51edba370344dcadca2bd3e932b609 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:55.396616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:55.496703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:55.559657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf8d4-3911-4a25-95fb-6f9b350b4268 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:55.604859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:55.605880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:55.606362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:55.606860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:55.620478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:55.625684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:55.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:43:55.627469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:43:55.630066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 100/203] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:55.636129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:55.771065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06beef3-5bea-480a-8e0b-9da74aa14660 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:55.810278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:55.811303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:55.811789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:55.812263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:55.813126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:55.813626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:55.815251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:55.824714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 104/204] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:55.831788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:55.964522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83390-14f0-494c-a4bd-b5013845798a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:55.990038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:56.006035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:56.007000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.007443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.007878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] PATH_INFO: `/v3/users/9adfdd11948b4ce0b772179374a07cd2` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.009944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9adfdd11948b4ce0b772179374a07cd2)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:56.011648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:56.013459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 101/205] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:55 2022] GET /identity/v3/users/9adfdd11948b4ce0b772179374a07cd2 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:56.019372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:56.031266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:56.156870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46674bea-8989-43df-b42b-9ed54a197dd3 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:56.198416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:56.199096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.199324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.199595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.288548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:56.290080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7a370-8cd3-46d6-9941-8da80671f365 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:56.292773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:56.427180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 105/206] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:56.440052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:56.530595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b002b-39cb-4902-aa99-d2b8a0ab00f9 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.531679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b002b-39cb-4902-aa99-d2b8a0ab00f9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.532574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b002b-39cb-4902-aa99-d2b8a0ab00f9 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.534164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 106/207] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:56.543046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b44c4-1c8d-4311-9bfd-6567981814c7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.543602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b44c4-1c8d-4311-9bfd-6567981814c7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.544075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b44c4-1c8d-4311-9bfd-6567981814c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.574653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1aa31-867e-4f5c-9158-838b0a5233d3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:56.587853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-324b44c4-1c8d-4311-9bfd-6567981814c7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:56.589435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-324b44c4-1c8d-4311-9bfd-6567981814c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:56.611586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:56.612304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.612649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.613257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.614601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:56.616397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:56.619353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 102/208] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:56 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:56.625227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:56.703089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:56.742248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 107/209] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:56.773603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4e1e7-07f8-4f81-b699-2a8b4c2213a4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:56.838962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:56.839496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.839774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.840045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.840777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, scope.project.id=7502ee0d26ee49a894884736dc09b0ca, user.id=9adfdd11948b4ce0b772179374a07cd2) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:56.841085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:56.842536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030331ae-ff19-47f8-8506-6ac9eaf52ff8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:56.848992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 103/210] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:56 2022] GET /identity/v3/role_assignments?user.id=9adfdd11948b4ce0b772179374a07cd2&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=b347c7ec85c44d84b60d838028750f8b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:56.860028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e42f-6433-4aa3-bc82-7408f441235f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.860641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e42f-6433-4aa3-bc82-7408f441235f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.861112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e42f-6433-4aa3-bc82-7408f441235f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.862699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 108/211] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:56.873254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26bab-7acd-4297-8743-a9ff34d0d4dc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:56.873568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26bab-7acd-4297-8743-a9ff34d0d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:56.873823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c26bab-7acd-4297-8743-a9ff34d0d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:56.895486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f5c26bab-7acd-4297-8743-a9ff34d0d4dc None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:56.896736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f5c26bab-7acd-4297-8743-a9ff34d0d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:56.986622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:57.116925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390e42f-6433-4aa3-bc82-7408f441235f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.159630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.229545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390e42f-6433-4aa3-bc82-7408f441235f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.252009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2481-91a2-443d-91b5-e81b78386d06 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.252304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2481-91a2-443d-91b5-e81b78386d06 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.252509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2481-91a2-443d-91b5-e81b78386d06 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.253901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 105/213] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:43:57.259518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.259793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.260060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.275745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.276812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.276812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.277011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.283750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:57.285612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:57.288918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:57.294487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:57.295425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:57.296660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 109/214] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:57.301845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.346601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.368935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 106/215] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:57.372292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.410479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.418768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d872-379c-49d2-bbc2-eefde22a0486 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.454543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.455326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.455817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.455970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.456521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:57.456816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:57.458201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:57.467879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 110/216] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:57.473704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.510144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969cbc7-7f34-4ac3-baad-ced2bc128b4f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.556649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.558090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.558565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.559825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.561398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:57.563759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:57.566014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 107/217] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:57.572323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.589454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181db37-bd11-463e-835c-2200e59834f1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.630640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.631296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.631582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.631854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] PATH_INFO: `/v3/users/d601a112eb974f7984f9653e594bdf78` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.642030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.646415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] RBAC: Authorizing `identity:get_user(user_id=d601a112eb974f7984f9653e594bdf78)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:57.647930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:57.650187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 111/218] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/users/d601a112eb974f7984f9653e594bdf78 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:57.655532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.672047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.695003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec7b6-0d22-43ff-a1ab-246578a614fa None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.730033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.730637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.730939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.731204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.731853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:57.733271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:57.758164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6951-bea3-4b56-a805-fa957a49b07c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.794160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:57.794800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:57.795079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:57.795342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:57.806147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:57.811408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:57.812307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:57.813156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 112/219] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:57.813829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.826546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 108/220] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:43:57 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:43:57.826546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:57.927937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.953151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32552-891d-4a37-aba7-3060acfdbe79 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:57.957820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:57.958666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d3da-eaa5-4872-a28f-82755bae0394 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.001784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.002814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.002814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.003002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.003090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.003488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.004450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:58.004549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.004620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.004685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.006075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762b539-2e4b-4174-87bf-0ec5baf87b39 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.016389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 109/221] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:58.018168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6827e03-c75e-4ab9-912f-e9d744cb71a5 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.018831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6827e03-c75e-4ab9-912f-e9d744cb71a5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.019605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6827e03-c75e-4ab9-912f-e9d744cb71a5 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.022407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 110/222] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:43:58.022407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6827e03-c75e-4ab9-912f-e9d744cb71a5 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.092798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.094286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.146355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6827e03-c75e-4ab9-912f-e9d744cb71a5 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.189065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.189997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.189997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.190242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.191414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.192865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f666-26ec-4451-ba18-9f3efb71b8ad None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.194694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 111/223] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:58.198171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.198456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.198759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.201019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:58.222091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:43:58.230761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:43:58.238841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 113/224] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:58.239847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.261591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:58.324847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 112/225] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:58.325926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.352169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0c2bd-f834-43ab-b16d-a4bb2d825662 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.409084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.409724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.410006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.410275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.413594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.415715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.417461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 114/226] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:58.423952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.500213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:58.503697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e643-0a7e-4ca4-997f-a8aac9d776c7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.549834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.550475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.550834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.551033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.555571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.556965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.558830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 113/227] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:58.564982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.582095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892012-076a-48a2-8e41-73a1f93d1473 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.624094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:58.624775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.625453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.625729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.625999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/users/a4ec6a338fae43c59700d3b0e62af1ef/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.627981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, user_id=a4ec6a338fae43c59700d3b0e62af1ef, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.629429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.699264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f5268-8d5e-4a81-aee6-52fc448f45b9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.702961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 115/228] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:58 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/users/a4ec6a338fae43c59700d3b0e62af1ef/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:43:58.709318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:58.771410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.774964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.775611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.776068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.777037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=d601a112eb974f7984f9653e594bdf78) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:58.777853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:58.779893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:58.792626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 114/229] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/role_assignments?user.id=d601a112eb974f7984f9653e594bdf78&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:43:58.900264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ddb4e-c7bf-4724-9e8b-7295fada52fd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:58.902065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:58.949684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:58.950332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:58.950610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:58.950911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:58.966269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:43:58.971352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:43:58.972474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:43:58.973371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 116/230] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:43:58.981583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:59.095997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:59.105757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0281a8-393c-4229-bd6c-6479eb4c3998 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:59.150537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:59.151188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:59.151470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:59.151744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:59.152422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:43:59.152727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:59.154106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:59.163012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 115/231] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:59.168430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:59.280057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f90d9-a439-4f22-aa3e-d4edb91f25d8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:59.316823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:59.317468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:59.317756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:59.318032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:59.319257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:59.321402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:59.323380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 117/232] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:43:59 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:59.328785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:59.435742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566067c-ca5e-4b80-89be-0de2f14d3975 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:59.476459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:59.477752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:59.478057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:59.478350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:59.479490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:59.480952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b3e7-5781-4ede-8bac-c7f4f96a285a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:59.482595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 116/233] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:43:59 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:43:59.494049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:43:59.534546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:59.619891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ceaf-9ced-418d-8075-a6077c015bf0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:43:59.654472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:43:59.655282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:43:59.655565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:43:59.655836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/users/a4ec6a338fae43c59700d3b0e62af1ef/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:43:59.658063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, user_id=a4ec6a338fae43c59700d3b0e62af1ef, role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:43:59.659553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e168-3609-45f3-a0b2-eebdc24a5b74 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:43:59.758593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 118/234] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:43:59 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/users/a4ec6a338fae43c59700d3b0e62af1ef/roles/af51edba370344dcadca2bd3e932b609 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:00.205563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84a13-0e66-48f0-b026-525bb2f48610 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.206070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84a13-0e66-48f0-b026-525bb2f48610 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.206175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84a13-0e66-48f0-b026-525bb2f48610 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.207745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 117/235] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:00.220421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.220710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.220988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.247781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:00.248993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:00.306228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771394ca-09bc-4f7e-9ba2-586547cfb673 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.306531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771394ca-09bc-4f7e-9ba2-586547cfb673 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.306799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771394ca-09bc-4f7e-9ba2-586547cfb673 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.308323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 118/236] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:00.314116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.314396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.314671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.344329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:00.345551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:00.360883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 119/237] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:00.387135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:00.444214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 119/238] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:00.668062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:00.690249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:00.739920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:00.826083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47154b-783a-4350-9623-68fc2633ad34 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:00.891802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:00.892441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.892717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.892985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.917220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81d165-5027-4b92-a441-42843c0a1b77 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:00.927753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:00.933021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:00.933973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:00.935079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:00.939270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 120/239] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:00.947821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:00.964441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:00.965050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:00.965328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:00.965602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:00.968199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:00.969665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:00.974015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 120/240] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:00.979042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:01.017793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.106632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.145318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5794c5-5ccc-43aa-a6ab-c2f58dc729d4 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:01.156310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283740b-e781-4d03-863d-e9ef9b4d094d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:01.218766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:01.219576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.219860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.220131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.220800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:01.222240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908fbb-1367-4f1c-9cd6-cc3c25ae377d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:01.223071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:01.223683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.223962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.224237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.225020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:01.225321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:01.226690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d1d3-c3f0-4efd-bfa3-7d88303ae8d2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:01.236387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 121/241] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:01.237588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b319e-962e-46cc-bc5b-f2e3392bd218 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.237872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b319e-962e-46cc-bc5b-f2e3392bd218 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.238145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b319e-962e-46cc-bc5b-f2e3392bd218 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.244098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 122/242] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:01.245123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b319e-962e-46cc-bc5b-f2e3392bd218 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:01.314454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 121/243] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:00 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:01.316364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2bb-3b62-4595-a7b2-a5cb25c47446 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.316901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2bb-3b62-4595-a7b2-a5cb25c47446 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.317399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2bb-3b62-4595-a7b2-a5cb25c47446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.348115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1e39f2bb-3b62-4595-a7b2-a5cb25c47446 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:01.349749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1e39f2bb-3b62-4595-a7b2-a5cb25c47446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:01.440708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 122/244] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:01.448299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897e2a-ed83-48b4-a760-f106495374a3 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.448597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897e2a-ed83-48b4-a760-f106495374a3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.448921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e897e2a-ed83-48b4-a760-f106495374a3 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.450554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 123/245] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:01.455793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b319e-962e-46cc-bc5b-f2e3392bd218 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:01.458950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.459236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.459508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.489238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:01.490383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:01.493825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.516797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:01.517702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.517982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.518252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] PATH_INFO: `/v3/users/5ae71d1791994c2d9b3ddb09a11a6560` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.534984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.537664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] RBAC: Authorizing `identity:get_user(user_id=5ae71d1791994c2d9b3ddb09a11a6560)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:01.539381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:01.541680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 123/246] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:01 2022] GET /identity/v3/users/5ae71d1791994c2d9b3ddb09a11a6560 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:01.547332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:01.575867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 124/247] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:01.658556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc800c-191b-40fa-8f1f-c39735aff958 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:01.695124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:01.695979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.696264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.696536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.765845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.767990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:01.769768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:01.780321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:01.893352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 124/248] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:01.900410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:01.918678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45486-55ca-4213-ad27-25eeb7daf6a8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:01.977724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:01.978493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:01.978684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:01.978987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:01.990758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:01.991569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:01.997809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:02.001207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 125/249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:02.002012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.031174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.034244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7408a-3ad5-451d-ac49-b58bfdaa80c7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.082486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.083162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.083440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.083710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.098124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:02.104951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:02.105904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:02.106707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 125/250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:02.111825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.146517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f725598-9fd1-4986-914c-b825fc07a4a1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.198433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.201068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.202314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.202783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.210520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.213155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.217296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 126/251] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:01 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.218248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.259380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e317-f5ab-4bfc-a25f-7e8d852a3c89 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.304757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.305995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.306228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.306657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.311315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:02.311636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.313159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.325296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 126/252] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.330537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.331526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.358793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.364630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8cf0-cb90-4cda-b630-12171bf73d8e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.407677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.408291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.408570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.408846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.409684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:02.409990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.411986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1fb32-5b70-46c7-b72e-e715152fadb6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.426829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 127/253] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.428394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfd26-3d16-493a-8bee-24770cf3f181 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.428676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfd26-3d16-493a-8bee-24770cf3f181 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.428942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfd26-3d16-493a-8bee-24770cf3f181 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.430428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 128/254] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:02.431163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbfd26-3d16-493a-8bee-24770cf3f181 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.464473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f5d8-934d-42ae-8729-670b1687c77c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.501106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.502115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.502644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.503208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.504228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=5ae71d1791994c2d9b3ddb09a11a6560) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:02.504731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.506451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.517097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 127/255] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/role_assignments?user.id=5ae71d1791994c2d9b3ddb09a11a6560&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=b347c7ec85c44d84b60d838028750f8b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.518204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.585896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbfd26-3d16-493a-8bee-24770cf3f181 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.646220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.660310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.661090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.661472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.668064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.668206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:02.668300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.668300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b5768-3690-436a-8749-b79022d0759d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.676286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 129/256] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.679299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.683692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.684368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.690602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5df89d-f92d-417c-911e-21acda2fab76 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.718363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:02.719617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:02.768657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.769640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.771072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.771571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] PATH_INFO: `/v3/users/d601a112eb974f7984f9653e594bdf78` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:02.773954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] RBAC: Authorizing `identity:get_user(user_id=d601a112eb974f7984f9653e594bdf78)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:02.776199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:02.778528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 128/257] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/users/d601a112eb974f7984f9653e594bdf78 => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:02.779981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.871900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 130/258] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:02.873400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:02.928501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8755-d83b-42d4-bea9-e81a6bc2384f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:02.980040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:02.980836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:02.981219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:02.981593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.025913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:03.043592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d79c2-935f-41b7-9a5b-9a3c0e7ab89b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:03.095118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:03.098166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:03.099732 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:03.105843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:03.106486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:03.106778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:03.107048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.109270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:03.109580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:03.119879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 131/259] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:03.125543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.269237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36762-e1f1-4852-b37c-ac4fde752a9d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:03.283150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 129/260] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:03.284055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.310629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:03.311671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:03.312182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:03.312675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/users/d601a112eb974f7984f9653e594bdf78/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.314879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, user_id=d601a112eb974f7984f9653e594bdf78, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:03.316519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:03.375033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:03.424853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 132/261] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:03 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/users/d601a112eb974f7984f9653e594bdf78/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:03.426421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.438863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694f79-5b8e-4c59-8a9d-da6bd72ac223 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:03.485137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:03.486959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:03.487463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:03.487984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.500778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:03.507060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:03.508593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:03.509409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:03.512371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 130/262] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:03.518504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.579803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:03.690930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b801b1b-5ae7-44db-a2d5-52881e35e246 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:03.723029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bfa1f-9da3-42c8-9543-14a4e9a15ff9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:03.740266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:03.770487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:03.771577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:03.772051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:03.772553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.775095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:03.777087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:03.779576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 133/263] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:03 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:03.783250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:03.784098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:03.784614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:03.785323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:03.790064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.790267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:03.790267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:03.790267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:03.810540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 131/264] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:03.826302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:03.969126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289e83-aa64-43bf-a535-1a6b1530ae35 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:04.009587 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:04.010214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.010490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.010778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] PATH_INFO: `/v3/users/a4ec6a338fae43c59700d3b0e62af1ef` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.012132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] RBAC: Authorizing `identity:get_user(user_id=a4ec6a338fae43c59700d3b0e62af1ef)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:04.013832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:04.016210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 132/265] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:03 2022] GET /identity/v3/users/a4ec6a338fae43c59700d3b0e62af1ef => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:04.027810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:04.030148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f3fb-a17e-4c6c-804a-d9d5cef36025 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:04.092094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:04.105700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:04.127428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:04.128402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.129078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.129552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.130480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=a4ec6a338fae43c59700d3b0e62af1ef) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:04.131007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:04.132627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5f0fd-400e-4d57-9b52-c7e6e1970e5e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:04.150368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 134/266] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:03 2022] GET /identity/v3/role_assignments?user.id=a4ec6a338fae43c59700d3b0e62af1ef&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:04.190094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c59a2-96af-47a9-9f2c-a6575ee7ca7f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:04.238209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:04.238772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.239043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.239313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.326259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:04.327770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff3743-62da-4170-9a36-2f1c51adba98 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:04.390799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:04.397895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952561-31bf-4d6d-b2c0-eb0d2d47b69d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.400308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952561-31bf-4d6d-b2c0-eb0d2d47b69d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.400308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952561-31bf-4d6d-b2c0-eb0d2d47b69d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.400308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 135/267] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:04.405798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ec16-8f9f-4e70-97e6-90aab4acaf46 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.406068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ec16-8f9f-4e70-97e6-90aab4acaf46 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.406341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441ec16-8f9f-4e70-97e6-90aab4acaf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.424897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5441ec16-8f9f-4e70-97e6-90aab4acaf46 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:04.426089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5441ec16-8f9f-4e70-97e6-90aab4acaf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:04.472078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 133/268] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:04.473715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add73-9a62-4cb3-8302-367bb22ad9cb None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.478752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add73-9a62-4cb3-8302-367bb22ad9cb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.479995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116add73-9a62-4cb3-8302-367bb22ad9cb None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.482712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 134/269] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:04.486680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116add73-9a62-4cb3-8302-367bb22ad9cb None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:04.522892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 136/270] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:04.531123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.531743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.532917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.569286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:04.572642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:04.687598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116add73-9a62-4cb3-8302-367bb22ad9cb None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:04.693436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 137/271] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:04.741335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:04.742350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.742862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.743354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.747293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:04.748996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:04.751358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 135/272] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:04 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:04.757627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:04.822494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:04.848127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:04.864126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:04.891719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a184b3-72ce-43f1-808b-b84f6633cdcf None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:04.939847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:04.940525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:04.940803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:04.941069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:04.941799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=a4ec6a338fae43c59700d3b0e62af1ef) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:04.942168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:04.943816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a559f20-3836-45b1-ad5f-aa5116bf01aa None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:04.950948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 138/273] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:04 2022] GET /identity/v3/role_assignments?user.id=a4ec6a338fae43c59700d3b0e62af1ef&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=af51edba370344dcadca2bd3e932b609 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:04.972922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac2cd8-bfe5-40d4-badc-e340da0152bd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.020929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a928d-0794-408f-ae00-325d1b7ceca7 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.021198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a928d-0794-408f-ae00-325d1b7ceca7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.021477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a928d-0794-408f-ae00-325d1b7ceca7 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.022835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 139/274] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:05.023135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.024809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.025323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.025764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.031581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:05.032183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.032467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.032741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.033071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:05.034932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 136/275] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:05.041667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.075949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:05.077151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:05.139028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.159928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f035fa-e2fa-4a1f-a42d-74e9a0cefc20 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.201046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.202049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.202588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.202905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.203574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:05.205020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:05.205735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 140/276] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:05.206585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.255363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.318010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d83909-8578-46eb-a2fe-ea819de8db25 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.350616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 137/277] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:05 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:44:05.361545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.362634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.363159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.363646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.376578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:05.382324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:05.383433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:05.384266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:05.387269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 141/278] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:05.399175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.489623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.516141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437412f-c56c-4183-a710-d0849da390e0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.566319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.567538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.567538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.567538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.569052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:05.569052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:05.569857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:05.574029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.584938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 138/279] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:05.592276 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.612133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824df3-4f3d-4c82-8987-31ac3bc67e24 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.613737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.656977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.657610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.657889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.658160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.671788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:05.677105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:05.678243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:05.679111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:05.681884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 142/280] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:05.687594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.732863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dc90-af28-4887-9ff3-472b89f6891c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.785380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.786744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.787351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.787631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] PATH_INFO: `/v3/users/080acc13b58f41448d09c26f861fb50f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.806515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] RBAC: Authorizing `identity:get_user(user_id=080acc13b58f41448d09c26f861fb50f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:05.808095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:05.810863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 139/281] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/users/080acc13b58f41448d09c26f861fb50f => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:05.813072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81f611-d8a1-48e8-adaa-f11a1b3423c0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:05.816771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.854425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:05.855432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:05.855981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:05.856517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:05.857388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:05.857861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:05.859419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:05.869732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 143/282] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:05.875655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:05.916223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.935604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:06.011838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06e03a-a9f6-40af-b4b6-1eaaf584a607 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:06.048371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:06.048988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.049266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.049535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.050271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, user.id=080acc13b58f41448d09c26f861fb50f, scope.system=all) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:06.050581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:06.052064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:06.058416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 140/283] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/role_assignments?user.id=080acc13b58f41448d09c26f861fb50f&scope.system=all&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:06.064817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb33de-ecdf-4233-99a3-dfe258309108 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:06.135629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:06.136212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.136494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.136767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] PATH_INFO: `/v3/users/5ae71d1791994c2d9b3ddb09a11a6560` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.138074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] RBAC: Authorizing `identity:get_user(user_id=5ae71d1791994c2d9b3ddb09a11a6560)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:06.139596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:06.141644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 144/284] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:05 2022] GET /identity/v3/users/5ae71d1791994c2d9b3ddb09a11a6560 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:06.147027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:06.321729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901696-5d61-40c6-8910-df431e565b60 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:06.350336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:06.370294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:06.370960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.371238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.371505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.372647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:06.374231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b177f86-a19a-45ae-8cbf-aae5aa8470ff None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:06.375920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 141/285] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:06 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:06.381862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:06.385565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feaf-7780-402e-8097-3a51d33ac81d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.385907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feaf-7780-402e-8097-3a51d33ac81d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.386128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1feaf-7780-402e-8097-3a51d33ac81d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.387467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 142/286] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:06.392396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.392678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.392949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.415493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:06.417068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:06.528973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 143/287] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:06.559310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:06.569111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff8a5-4230-4287-8bf8-f5e9df8a1c79 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:06.606011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:06.606666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:06.606970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:06.607230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/users/5ae71d1791994c2d9b3ddb09a11a6560/roles/b347c7ec85c44d84b60d838028750f8b` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:06.609132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, user_id=5ae71d1791994c2d9b3ddb09a11a6560, role_id=b347c7ec85c44d84b60d838028750f8b)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:06.610624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:06.678059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 145/288] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:06 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/users/5ae71d1791994c2d9b3ddb09a11a6560/roles/b347c7ec85c44d84b60d838028750f8b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:06.870664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:07.009766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeade3-da36-4a53-a7ce-f816ded2f4d6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:07.028062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:07.046312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:07.046974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:07.047301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:07.047576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:07.059411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:07.064494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:07.065500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:07.066416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 144/289] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:07.072496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:07.175439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282605e-de43-4a16-ad3f-f0bc97be5bc8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:07.210663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:07.211257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:07.211536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:07.211803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:07.212521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:07.212825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:07.214180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:07.222511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 146/290] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:07.228563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:07.341325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f3839-77a2-44d4-be20-4e401e6b32a6 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:07.392461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:07.393111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:07.393431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:07.393705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] PATH_INFO: `/v3/users/d601a112eb974f7984f9653e594bdf78` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:07.394989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=d601a112eb974f7984f9653e594bdf78)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:07.396604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:07.399148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 145/291] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:07 2022] GET /identity/v3/users/d601a112eb974f7984f9653e594bdf78 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:07.404606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:07.435093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:07.519164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ef2cd-12cc-405a-b962-c838dbe2c190 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:07.555569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:07.556220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:07.556495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:07.556758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:07.627086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:07.628534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:07.650582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:07.732739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 147/292] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:07.738277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:07.798915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:07.864829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef5807-3de5-4083-90d6-7becdbf24bf3 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:07.914250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:07.914911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:07.915218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:07.915491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:07.917435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:07.918910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e995a1-9dbf-41f9-b079-c600edcac521 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:07.920704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 146/293] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:07 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:07.926411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:08.045198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e11ed3-b355-4718-8b31-09a67f346e40 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.045516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e11ed3-b355-4718-8b31-09a67f346e40 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.045754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e11ed3-b355-4718-8b31-09a67f346e40 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.047361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 147/294] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:08.052524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df49-1a71-488e-8257-61cbe69b7f15 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.052748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df49-1a71-488e-8257-61cbe69b7f15 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.053024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df49-1a71-488e-8257-61cbe69b7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.078361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f7a4df49-1a71-488e-8257-61cbe69b7f15 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:08.082164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f7a4df49-1a71-488e-8257-61cbe69b7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:08.092275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304b08-0fdc-4b3b-95fa-7f2f62100595 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:08.107968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.128491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:08.129096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.129369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.129632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.130355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=d601a112eb974f7984f9653e594bdf78) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:08.130657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:08.132107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec10-05f4-4718-be5b-bc7fcd6ba5e2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:08.144680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 148/295] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:07 2022] GET /identity/v3/role_assignments?user.id=d601a112eb974f7984f9653e594bdf78&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:08.209492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94b9a-3ddb-49c0-8010-11772a83644a None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.209770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94b9a-3ddb-49c0-8010-11772a83644a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.210042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94b9a-3ddb-49c0-8010-11772a83644a None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.212087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 149/296] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:08.215914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 148/297] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:08.218310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e02cb-f700-4122-ab06-eb53161b18eb None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.218590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e02cb-f700-4122-ab06-eb53161b18eb None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.218890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e02cb-f700-4122-ab06-eb53161b18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.244218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3e6e02cb-f700-4122-ab06-eb53161b18eb None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:08.245472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3e6e02cb-f700-4122-ab06-eb53161b18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:08.361147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 150/298] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:08.518319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a258-d841-40cc-a984-ba059e0c211b None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.518685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a258-d841-40cc-a984-ba059e0c211b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.518904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a258-d841-40cc-a984-ba059e0c211b None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.520521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 149/299] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:08.527000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.527284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.527553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.549497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:08.550685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:08.595301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a258-d841-40cc-a984-ba059e0c211b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:08.636943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 151/300] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:08.658045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:08.661378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.706770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.745334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a258-d841-40cc-a984-ba059e0c211b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:08.777497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872e13-300a-4123-9119-35794c4a5f6a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:08.792173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:08.792927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.793212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.793485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.808329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:08.813917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:08.815117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:08.815945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:08.818450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 150/301] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:08.822453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:08.826756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.826756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.826756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.827093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:08.827927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:08.829830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:08.831867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 152/302] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:08.837448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:08.950476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c9a0-dc4c-43e5-893a-3c7aff3cff7c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:08.959176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.963796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182760b4-0a0d-4850-a417-de8d06621f19 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:08.967153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.988589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:08.989203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:08.989526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:08.989956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] PATH_INFO: `/v3/groups` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:08.990436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:08.991953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.000508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.001113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.001389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.001659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.002328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:09.002630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.004046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.012715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 151/303] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:09.014351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.113562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 153/304] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Sep 1 17:44:08 2022] POST /identity/v3/groups => generated 229 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:09.114699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.127960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d9c20-7779-450c-afc9-75bb7178ac32 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.188557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.189778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.190239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.190929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.209106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8642cac5-04a4-49cf-b3ff-2acca4052999 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:09.217424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:09.218393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:09.219255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:09.225563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 152/305] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:09.225563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9aec-b12d-4be9-b9b3-7aff228c11a1 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.225563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9aec-b12d-4be9-b9b3-7aff228c11a1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.225563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9aec-b12d-4be9-b9b3-7aff228c11a1 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.228204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 153/306] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:09.232269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9aec-b12d-4be9-b9b3-7aff228c11a1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.251867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4593d9-a969-4a13-aff0-503392520c05 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.266172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.296228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.296864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.297146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.297415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] PATH_INFO: `/v3/users/590413989cd042a4aee1e9bbfc330721` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.312661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] RBAC: Authorizing `identity:get_user(user_id=590413989cd042a4aee1e9bbfc330721)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.314184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdbcfb-1306-4698-b6e8-ce77a2ac532f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.315909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 154/307] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/users/590413989cd042a4aee1e9bbfc330721 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:09.317215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.317502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.317771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.338155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:09.339376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:09.355295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9aec-b12d-4be9-b9b3-7aff228c11a1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.357173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.395185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.395792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.396077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.396405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.397082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:09.397387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.399080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.407080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 155/308] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:09.407562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 154/309] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:09.412278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.414841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.517793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.519163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7461-9dda-4374-829c-5d940fa81ce1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.532078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206b60-8115-4b60-873c-81f9e2b5fe7b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.555464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.556418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.556701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.556972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.557700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, user.id=590413989cd042a4aee1e9bbfc330721, scope.system=all) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:09.558003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.559718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.565117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 156/310] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/role_assignments?user.id=590413989cd042a4aee1e9bbfc330721&scope.system=all&role.id=b347c7ec85c44d84b60d838028750f8b => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:09.574522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.575585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.576102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.576584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] PATH_INFO: `/v3/users/080acc13b58f41448d09c26f861fb50f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.578321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] RBAC: Authorizing `identity:get_user(user_id=080acc13b58f41448d09c26f861fb50f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.580418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.582873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 155/311] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/users/080acc13b58f41448d09c26f861fb50f => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:09.589445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.610562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.681329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.706279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a9ae-3f00-4bcc-92b6-0875f35036bc None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.752124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.753283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.753694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.754100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] PATH_INFO: `/v3/system/users/080acc13b58f41448d09c26f861fb50f/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.756176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=080acc13b58f41448d09c26f861fb50f, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:09.757874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:09.796300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a7dbc-589e-434a-ac96-ee9f6024603f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:09.832337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:09.832994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:09.833268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:09.833537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:09.843788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:09.853750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:09.855459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 156/313] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:09.856275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:09.857571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 157/313] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Sep 1 17:44:09 2022] PUT /identity/v3/system/users/080acc13b58f41448d09c26f861fb50f/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:09.878660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.985986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a6bf-d2a6-416d-b872-7fa30a263244 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:10.025153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:10.025763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:10.026036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:10.026301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:10.027002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:10.027298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:10.028872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:10.037553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 157/314] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:10.044793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:10.134279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:10.160460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3029f80-7637-4be2-854c-d5d9276c0047 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:10.196697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:10.197328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:10.197603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:10.197872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] PATH_INFO: `/v3/users/5ae71d1791994c2d9b3ddb09a11a6560` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:10.199042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] RBAC: Authorizing `identity:get_user(user_id=5ae71d1791994c2d9b3ddb09a11a6560)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:10.200482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:10.202136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 158/315] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:10 2022] GET /identity/v3/users/5ae71d1791994c2d9b3ddb09a11a6560 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:10.208043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:10.296677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:10.318834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64079-35a5-4fd3-84d3-9f84d0ac576e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:10.354115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:10.354748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:10.355024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:10.355295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:10.423866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:10.425256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:10.502856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:10.525795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 158/316] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:10.531564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:10.657907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ff85-db91-4246-8d03-8ae741ea1f0a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:10.706566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:10.707987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:10.708463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:10.708928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:10.710364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:10.712831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e00c2-d516-44e7-bf3f-a0937d666ce5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:10.722683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 159/317] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:10 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:10.727530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:10.841058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da975c3f-dd74-4315-a8f8-e62181e4c400 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:10.876843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:10.877446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:10.877721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:10.878003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:10.878740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, scope.project.id=69e45e7543e043b8b177989dee9458fd, user.id=5ae71d1791994c2d9b3ddb09a11a6560) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:10.879044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:10.880463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bb65-80b2-4986-9e85-8ddd8f4079bb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:10.886638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 159/318] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:10 2022] GET /identity/v3/role_assignments?user.id=5ae71d1791994c2d9b3ddb09a11a6560&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=b347c7ec85c44d84b60d838028750f8b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:11.162078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93899-df5d-4aa1-ab3b-bc174644b401 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.162406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93899-df5d-4aa1-ab3b-bc174644b401 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.162896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac93899-df5d-4aa1-ab3b-bc174644b401 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.164701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 160/319] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:11.169827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571aaa-d07e-42ed-806b-e24bc149181c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.170115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571aaa-d07e-42ed-806b-e24bc149181c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.170388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571aaa-d07e-42ed-806b-e24bc149181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.189314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ca571aaa-d07e-42ed-806b-e24bc149181c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:11.190488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ca571aaa-d07e-42ed-806b-e24bc149181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:11.228085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:11.260033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 160/320] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:11.530680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93899-df5d-4aa1-ab3b-bc174644b401 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:11.551133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:11.624527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90b30-001a-468f-9393-170ef485fd07 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.624803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90b30-001a-468f-9393-170ef485fd07 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.625070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90b30-001a-468f-9393-170ef485fd07 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.626539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 161/321] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:11.631185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6fc0-4853-4d86-9ce3-441a586c9c94 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.631456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6fc0-4853-4d86-9ce3-441a586c9c94 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.631728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6fc0-4853-4d86-9ce3-441a586c9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.637210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac93899-df5d-4aa1-ab3b-bc174644b401 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:11.650496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-38ef6fc0-4853-4d86-9ce3-441a586c9c94 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:11.651783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-38ef6fc0-4853-4d86-9ce3-441a586c9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:11.676556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:11.677181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.677570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.677916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.679159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:11.681293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:11.686945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 161/322] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:11.688734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:11.722008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 162/323] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:11.778385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:11.794801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a127d-db89-46e8-b8a7-7ccb93e21664 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:11.829520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:11.830124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.830402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.830672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] PATH_INFO: `/v3/groups` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.831322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:11.832875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:11.850555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f860-8717-409e-afc8-b64d5758e27e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.851073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f860-8717-409e-afc8-b64d5758e27e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.851304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387f860-8717-409e-afc8-b64d5758e27e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.853352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 163/324] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:11.858267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:11.858554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:11.858897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:11.876829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:11.878109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:11.933530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 162/325] 10.222.0.58 () {60 vars in 1134 bytes} [Thu Sep 1 17:44:11 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:44:11.956337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 164/326] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:11.995074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.132223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee51eb-99d1-4f0c-b4c4-ba22a588edeb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.167842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.168464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.168745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.169015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.180908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:12.186550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:12.187526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:12.188497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 163/327] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:12.193406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.232436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:12.288080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.298865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:12.309759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065650d-aef3-4db3-82a4-fc39e5f981dd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.369110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.369958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.370246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.370521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.371247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:12.371644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:12.373079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:12.382458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 165/328] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:12.389962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.442964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86254e-b022-46fd-9450-a1294e7aafc3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.479359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.480007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.480303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.480559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.492712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:12.497979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:12.498917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:12.499735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 164/329] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:12.505388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.519430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:12.529154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a0ea-2a9e-4cd5-a355-fbfb3ad7c0cd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.584463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.585368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.585651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.587132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] PATH_INFO: `/v3/users/590413989cd042a4aee1e9bbfc330721` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.589458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] RBAC: Authorizing `identity:get_user(user_id=590413989cd042a4aee1e9bbfc330721)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:12.591337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:12.594226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 166/330] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/users/590413989cd042a4aee1e9bbfc330721 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:12.601739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:12.602264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.646551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb01b-7de4-4d87-888c-4f4509b2cd53 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.688859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.689525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.689809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.690081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.690780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:12.691092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:12.692492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:12.703450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 165/331] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:12.708969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.746011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99828d-41f1-4240-8f23-5cc27b963f50 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.792840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.793968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.794472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.794971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] PATH_INFO: `/v3/system/users/590413989cd042a4aee1e9bbfc330721/roles/b347c7ec85c44d84b60d838028750f8b` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.797394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=590413989cd042a4aee1e9bbfc330721, role_id=b347c7ec85c44d84b60d838028750f8b)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:12.799530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:12.838337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec6ecf-e85a-4e31-bd40-05c148e307fc None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:12.865078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 167/332] 10.222.0.58 () {58 vars in 1334 bytes} [Thu Sep 1 17:44:12 2022] PUT /identity/v3/system/users/590413989cd042a4aee1e9bbfc330721/roles/b347c7ec85c44d84b60d838028750f8b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:12.868436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:12.876937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:12.877595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:12.877873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:12.878143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] PATH_INFO: `/v3/users/080acc13b58f41448d09c26f861fb50f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:12.879419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] RBAC: Authorizing `identity:get_user(user_id=080acc13b58f41448d09c26f861fb50f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:12.881011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bb1b-13bb-4fbd-903e-840e2fb7550e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:12.882760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 166/333] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/users/080acc13b58f41448d09c26f861fb50f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:12.889614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:12.921404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:13.018406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b73c42-05c3-469b-b0c3-3649da3c6133 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:13.065754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:13.066368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:13.066645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:13.066943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:13.067681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] RBAC: Adding query filter params (role.id=cee4828f017b4ac7a91a87c02aef60b9, user.id=080acc13b58f41448d09c26f861fb50f, scope.system=all) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:13.067986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:13.069421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0226a-df65-41cf-a1d3-85e1b919aa1c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:13.083758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 168/334] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Sep 1 17:44:12 2022] GET /identity/v3/role_assignments?user.id=080acc13b58f41448d09c26f861fb50f&scope.system=all&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:14.286714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f5e-0799-49a3-a42c-97e65c8a8737 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:14.287261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f5e-0799-49a3-a42c-97e65c8a8737 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:14.287261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f5e-0799-49a3-a42c-97e65c8a8737 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:14.288638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 167/335] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:14.294814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dd17-7b7d-4071-970d-dd1726f4dea3 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:14.295254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dd17-7b7d-4071-970d-dd1726f4dea3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:14.295341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0dd17-7b7d-4071-970d-dd1726f4dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:14.316616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0be0dd17-7b7d-4071-970d-dd1726f4dea3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:14.317821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0be0dd17-7b7d-4071-970d-dd1726f4dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:14.390965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 169/336] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:14.457578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0dff2-69aa-45ef-9674-197e84bcc242 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:14.457898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0dff2-69aa-45ef-9674-197e84bcc242 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:14.458127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0dff2-69aa-45ef-9674-197e84bcc242 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:14.459521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 168/337] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:14.465385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:14.465845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:14.466126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:14.487190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:14.488390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:14.499537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:14.566833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 170/338] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:14.823177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0dff2-69aa-45ef-9674-197e84bcc242 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:14.952741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0dff2-69aa-45ef-9674-197e84bcc242 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:14.995162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c953e-a052-495e-84de-a02049b45882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:14.995858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c953e-a052-495e-84de-a02049b45882 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:14.996144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c953e-a052-495e-84de-a02049b45882 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:14.996419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c953e-a052-495e-84de-a02049b45882 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.010328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c953e-a052-495e-84de-a02049b45882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-578c953e-a052-495e-84de-a02049b45882 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:15.015948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:15.016910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:15.017744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 169/339] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:15.023033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:15.125228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c953e-a052-495e-84de-a02049b45882 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:15.202010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6107e-fd60-4c87-a346-8d83c657778f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:15.234963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:15.281379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:15.281996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.282274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.282689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.283250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:15.283552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:15.284992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:15.302277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 171/340] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:15.307697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:15.311292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c953e-a052-495e-84de-a02049b45882 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:15.325244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:15.381039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:15.381604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.381885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.382157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.398064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:15.407675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:15.408638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:15.409448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 170/341] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:15.415358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:15.481508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5dfb-b412-46a1-b147-6efd4725d305 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:15.547498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:15.548131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.548419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.548671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.568166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb13ae-e471-4dbf-93f7-403e71435c87 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:15.603530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:15.628677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:15.629296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.629578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.629851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.630525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:15.638873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:15.640232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0c298-530a-40bd-935a-bb254ead7570 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:15.651705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 171/342] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:15.653518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d0368-d4f3-42bc-bab1-afd75846bc41 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.653911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d0368-d4f3-42bc-bab1-afd75846bc41 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.654192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d0368-d4f3-42bc-bab1-afd75846bc41 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.655684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 172/343] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:15.658410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d0368-d4f3-42bc-bab1-afd75846bc41 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:15.706067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:15.709175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9a682-d6c1-4b4a-bc68-68be40a34c91 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:15.723049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:15.879069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d0368-d4f3-42bc-bab1-afd75846bc41 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:15.928582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 172/344] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:15.929410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:15.929817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.930077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:15.930307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.930441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:15.930660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.930823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:15.979799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:15.981011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:16.000794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.028613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:16.030833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46add0-4017-4a2b-a35d-2bb67bc41f49 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:16.081790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 173/345] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:16.086756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.156561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.210943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 173/346] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:16.214305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c20-02cc-4f75-93fc-e92ea9dcff2a None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.214591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c20-02cc-4f75-93fc-e92ea9dcff2a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.214904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77c20-02cc-4f75-93fc-e92ea9dcff2a None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.216244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 174/347] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:16.231963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77c20-02cc-4f75-93fc-e92ea9dcff2a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.282588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc9bf9-fa1a-4919-9646-dd99cf7e428e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:16.331236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:16.331865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.332142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.332418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.333569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:16.335097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f3dc8-438f-4045-a4ce-06a3394da515 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:16.337940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 174/348] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:16.339798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16950-d7cf-4706-b2b3-fa8c7ba0f37b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.340079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16950-d7cf-4706-b2b3-fa8c7ba0f37b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.340350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16950-d7cf-4706-b2b3-fa8c7ba0f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.360504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-78c16950-d7cf-4706-b2b3-fa8c7ba0f37b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:16.361702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-78c16950-d7cf-4706-b2b3-fa8c7ba0f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:16.362826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.392866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77c20-02cc-4f75-93fc-e92ea9dcff2a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:16.444406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 175/349] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:16.446069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c2e3b-539c-46de-a569-7437b507bb03 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.446355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c2e3b-539c-46de-a569-7437b507bb03 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.446530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:16.446676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c2e3b-539c-46de-a569-7437b507bb03 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.447403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.447731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.448004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.448695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 176/350] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:16.449211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c2e3b-539c-46de-a569-7437b507bb03 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.452694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:16.455351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34541b-2092-47c5-89d7-2c2ebabc2f23 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:16.462702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 175/351] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:16.465897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.466232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.466504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.491730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:16.493531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:16.497520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.580676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c2e3b-539c-46de-a569-7437b507bb03 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:16.597755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 176/352] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:16.598987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.631533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:16.632610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.633726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.634204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.642447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:16.643983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:16.650827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 177/353] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:16.651752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.745645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.787177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6e18-d862-4004-96f3-a0c95f535d08 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:16.828254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:16.833415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cfcb-0f1c-4d29-bb01-e75388ac324c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:16.848377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:16.849736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.850303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.850753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.854064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:16.856515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:16.858715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 177/354] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:16.859683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.883723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:16.884587 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:16.884965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:16.885347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:16.897130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:16.902789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:16.903914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:16.904950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 178/355] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:16.905646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:16.994403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1162a-c8a5-49e3-ac23-9e488bb6a828 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.034695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.035285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e619-b5af-471c-af36-ceceb7f235ce None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.035394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.035663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.035930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.036768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=7502ee0d26ee49a894884736dc09b0ca) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:17.036953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:17.038771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:17.045215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 178/356] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:17.054018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.064757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.084350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.085008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.085392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.085669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.102436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7a56ba77-5b2a-4ad3-8dfe-0056fa62bf06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:17.108799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:17.109793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:17.110615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 179/357] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:17.111343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ecaa5-e1a9-4354-a843-a3da8d154b0e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.111476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ecaa5-e1a9-4354-a843-a3da8d154b0e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.111747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ecaa5-e1a9-4354-a843-a3da8d154b0e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.113922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 180/358] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:17.114528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ecaa5-e1a9-4354-a843-a3da8d154b0e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.141630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.207548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad38ec-133b-458c-afc0-78884f96fcc2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.249982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.250595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.250910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.251176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.251901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=7502ee0d26ee49a894884736dc09b0ca) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:17.252203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:17.253652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:17.259632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 179/359] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=af51edba370344dcadca2bd3e932b609 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:17.260232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.261132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ecaa5-e1a9-4354-a843-a3da8d154b0e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.310965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.311946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.312419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.312879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.313776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:17.314284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:17.316180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2287892-277c-45c5-bada-b3f92b4df49b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:17.329537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 181/360] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:17.331708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.332617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.333082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.360576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:17.363151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.365665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:17.401815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b29ac-b6bc-41d8-af72-1bc81fb0d433 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.453615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.453955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.454171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.454437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.467429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 182/361] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:17.477517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:17.478234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:17.479180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:17.480418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 180/362] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:17.481098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.481549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.498299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.608715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195dea-5313-4832-8157-288106e27fb8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.673890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.684098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.684981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.686877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.686877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.695493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5c86d-a4e6-472e-a584-a645dde96b8b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.772922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:17.774209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:17.774669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:17.774974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:17.775657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:17.775964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:17.777349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:17.800544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 183/363] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:17.801419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:17.827735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:17.829209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:17.901756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:17.946962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14b786-7814-41e6-ab06-da5123ebc3d8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:17.967171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 181/364] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:17.968268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.000499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.001428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.001919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.002356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.003421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:18.004089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.005655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.010801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.016862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 184/365] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.018034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.109195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c6bc-5c3e-4dad-94d9-0b42a2addb56 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.152699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.153733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.154199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.154700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] PATH_INFO: `/v3/users/590413989cd042a4aee1e9bbfc330721` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.156056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] RBAC: Authorizing `identity:get_user(user_id=590413989cd042a4aee1e9bbfc330721)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.157708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.159830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 182/366] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:44:17 2022] GET /identity/v3/users/590413989cd042a4aee1e9bbfc330721 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.160768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.162544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca47efc-69b4-44ab-821c-482da15cfff0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.210122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.211212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.211689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.212151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.215509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.226077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:18.232054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:18.234962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:18.236214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:18.238251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 185/367] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:18.239259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.296666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.300898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370188c5-623b-4c91-9d18-2009618af46e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.352299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.353362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.353923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.354529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.356291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.358607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.367949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 183/368] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.369735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.370066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fcb5d-62e1-4846-834d-f345896ba931 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.414858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.415102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.415333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.416326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.496327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7380-e9f9-430c-800e-49b62d21b562 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.500524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.509600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.513878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.542823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.543720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.544147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.544577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.545475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] RBAC: Adding query filter params (role.id=b347c7ec85c44d84b60d838028750f8b, user.id=590413989cd042a4aee1e9bbfc330721, scope.system=all) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:18.545935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.547696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.562291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 184/369] 10.222.0.58 () {56 vars in 1308 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/role_assignments?user.id=590413989cd042a4aee1e9bbfc330721&scope.system=all&role.id=b347c7ec85c44d84b60d838028750f8b => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.563554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.615719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.656614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 186/370] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:18.657519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.753091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab436a-c7ae-49fe-a495-3d41c054459b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.813259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.814251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.814762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.815238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.816112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:18.816609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.819685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.838897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 185/371] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.838897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.863376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.871050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60a82-d47c-4f04-a305-d11e7e44e711 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:18.921412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:18.922530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:18.922530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:18.922717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:18.923924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:18.925417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:18.927844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 187/372] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:18.933326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:18.964692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:18.985334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258096b-7181-4226-94bc-99ddaa3af8f1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.037917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.039077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.039677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.040146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.041520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.043309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.045311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 186/373] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:19.046318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.080316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5ca8-6fba-450f-a6f7-2f1bb0b3daca None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.134151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.135240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.135711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.136172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.177463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.187422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f503-a5b1-4ba0-b7f0-6576f150a909 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.225067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.227457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b359d-421c-493b-8d1c-afa139d5088b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.233293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.233983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.234205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.234464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.235228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=69e45e7543e043b8b177989dee9458fd) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:19.235534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.236966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.250796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 187/374] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:19.250796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.274460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.373077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd99e7-b58d-4773-9a48-d7652ba835b9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.406825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 188/375] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:19.408242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e47a4-ca3b-49ab-933b-1b15aa926199 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.408485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e47a4-ca3b-49ab-933b-1b15aa926199 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.408756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e47a4-ca3b-49ab-933b-1b15aa926199 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.410382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 189/376] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:19.416480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e47a4-ca3b-49ab-933b-1b15aa926199 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.424049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.424769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.425051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.425324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.426503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.428020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c812-074d-43c1-b23f-fff4b6287411 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.430075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 188/377] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:19.431535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.431816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.432086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.454428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:19.455731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:19.506283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.535206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 189/378] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:19.542762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.574692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e47a4-ca3b-49ab-933b-1b15aa926199 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.579028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.628578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.629132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.629410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.629680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] PATH_INFO: `/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.630849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=96c7134db2ce4630a56e3b2cec77b0cf)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.632307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead167-7bb9-4e8a-b70e-e494ce38f5c7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.634907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 190/379] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:19.635862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d96de-d344-4e03-87ff-c486b0a5811c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.636142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d96de-d344-4e03-87ff-c486b0a5811c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.636414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d96de-d344-4e03-87ff-c486b0a5811c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.637866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 191/380] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:19.641418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d96de-d344-4e03-87ff-c486b0a5811c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.690747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09fad-e445-43bf-9086-e8c425ac7f76 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.739519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.740245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.740593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.740923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.741717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=69e45e7543e043b8b177989dee9458fd) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:19.742198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.743761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354ab5-7aca-4f2d-996b-b77701d35480 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.754463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 190/381] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=af51edba370344dcadca2bd3e932b609 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:19.754463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.754463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.754463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.773230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:19.775137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:19.793893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d96de-d344-4e03-87ff-c486b0a5811c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:19.833644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:19.847764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:19.853712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:19.853712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:19.853712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] PATH_INFO: `/v3/groups/98bae3c6447140bdaa1ee13d12ad9035` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:19.857504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] RBAC: Authorizing `identity:get_group(group_id=98bae3c6447140bdaa1ee13d12ad9035)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:19.860044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:19.866843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 191/383] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:19.867638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 192/383] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/groups/98bae3c6447140bdaa1ee13d12ad9035 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:19.869641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.883420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:19.889943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:20.045411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0314-e92c-4581-b25e-9aa88932afa9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.059143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e591-3a1f-490c-8717-83be5c0f1527 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.100961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.102956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.103378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.103786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.106760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.107363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.107752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.108115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.109116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] RBAC: Adding query filter params (group.id=98bae3c6447140bdaa1ee13d12ad9035, role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=96c7134db2ce4630a56e3b2cec77b0cf) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:20.109591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:20.111140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:20.123058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 192/384] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/role_assignments?group.id=98bae3c6447140bdaa1ee13d12ad9035&scope.project.id=96c7134db2ce4630a56e3b2cec77b0cf&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:20.123865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:20.129481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:20.130514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:20.131871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 193/385] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:20.140283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.168714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.291596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:20.299648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:20.326310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c6303-f8e7-4fe8-b7a8-0a254dfed2db None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.350028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9216-c960-4a8b-8fa9-a4f3918e3f8c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.375593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.376233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.377015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.377297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.378109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:20.378706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:20.380378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:20.392402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 193/386] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:20.393725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.394368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.394642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.394956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.397774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.417744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:20.423203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:20.424108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:20.424916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 194/387] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:20.431989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.564677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153bd3-6ef4-4949-b683-ece98a9fd58f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.636697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.637339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.637616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.637881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.642315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:20.643790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:20.645353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 194/388] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:20.647636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d089fe-f6bb-4573-a0b7-becdf29d9109 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.652730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.670431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:20.676386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:20.717791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.718862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.719143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.720185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.720868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:20.721170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:20.722578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:20.745612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 195/389] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:20.752183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.877511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f25f6-e8ac-4e67-8b04-94e601b8ac1d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.914770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:20.915097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:20.915322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:20.915590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:20.916726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:20.917098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4873f-1492-4827-bf3a-a0364812cc62 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:20.918238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:20.920388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 196/390] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:20.925536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:20.994573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:21.051450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:21.052095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.052369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.052632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.055264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40660a1-0e74-4092-b681-4c9423d2d246 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:21.059748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:21.061208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:21.063245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 195/391] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:21.071656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:21.096699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:21.097471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.097757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.098028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.099213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:21.101041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:21.103102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 197/392] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:20 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:21.111838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:21.232061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:21.266961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bb433-afbc-40d8-a5f2-2dadece27211 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:21.280113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2945c2-4d92-47e0-9806-ef0607e258a5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:21.287255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:21.312996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:21.313675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.313985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.314216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.322665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, group_id=1c23fe0649044bb6a3cca02ff053a67f, role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:21.328095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556cc4d-6adf-4c93-ab2f-3aa67ec54612 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:21.356436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:21.357114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.357391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.357661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.359638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] RBAC: Authorizing `identity:create_grant(project_id=7502ee0d26ee49a894884736dc09b0ca, group_id=1c23fe0649044bb6a3cca02ff053a67f, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:21.361858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0edd-17ff-4962-8ffd-ae5498d83098 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:21.410263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 198/393] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Sep 1 17:44:21 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/af51edba370344dcadca2bd3e932b609 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:21.440237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 196/394] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Sep 1 17:44:21 2022] PUT /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:21.694416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8db8-1eca-4773-a948-865ab9ae5cef None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.694957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8db8-1eca-4773-a948-865ab9ae5cef None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.695083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8db8-1eca-4773-a948-865ab9ae5cef None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.696630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 199/395] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:21.702213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:21.702491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:21.702830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:21.724693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:21.725949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:21.849614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 197/396] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:22.372667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8db8-1eca-4773-a948-865ab9ae5cef None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:22.510225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8db8-1eca-4773-a948-865ab9ae5cef None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:22.553794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:22.555370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.555864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.556326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.572347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ba696684-7ff9-479b-b09b-fbbbe150e731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:22.578036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:22.578980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:22.579801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:22.586681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 200/397] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:22.588024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:22.647145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0588-81fe-4fcf-9647-fad307ead267 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.647744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0588-81fe-4fcf-9647-fad307ead267 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.648265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0588-81fe-4fcf-9647-fad307ead267 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.650059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 201/398] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:22.667591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.667876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.668153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.685388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:22.706059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:22.707513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:22.738191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7ddae-1ea5-46eb-bf45-c7842d8127c0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:22.742636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:22.785146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:22.786286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.786718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.787054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.787756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:22.788062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:22.790114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe0929-23ec-43a8-bd95-e31e0cbb448a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:22.802829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 198/399] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:22.804476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e679a-bcc1-4b1e-b77e-334fa65057d6 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.805357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e679a-bcc1-4b1e-b77e-334fa65057d6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.805785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e679a-bcc1-4b1e-b77e-334fa65057d6 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.807159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 202/400] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:22.809781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:22.818902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 199/401] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:22 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:22.821212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:22.821891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:22.822325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:22.854466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:22.855969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:22.951119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 200/402] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:23.005873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fd9d2-af4a-46d8-8cdf-d2834a0d42cd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.046447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.047130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.047405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.047674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.051353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.052788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.054868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 203/403] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:22 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:23.060245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.135013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.147775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.168902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.238816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938fba-67fb-41dd-821a-64495ebc08ea None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.248354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b151d-2b55-46ec-a653-24c1bf6f0611 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.286342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.287336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.287750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.288181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.299386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:23.305008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:23.305905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:23.306690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:23.309657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 204/404] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:23.315037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.315160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.315160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.315160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.315160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.315441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.315441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.317135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 201/405] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:23.317965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.411983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.422550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f691ec-0107-4424-adaf-1c3501446fc0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.426600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364e80-6846-4323-ac78-3d1a4a0b4a6a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.451885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.460717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.461777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.462240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.466752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.466853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.466853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.466853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.466853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.467143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:23.467143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.467417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.474513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:23.480889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 202/406] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:23.480889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:23.485437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:23.486598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:23.487457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:23.489777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 205/407] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:23.490949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.598751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba961f72-91c2-4310-81d7-9e67a7ed29af None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.608817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438d79a-36d1-4189-9892-9ce9108c6ab6 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.638742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.639445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.639831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.639994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.641992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, group_id=1c23fe0649044bb6a3cca02ff053a67f, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.643392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aff48f-764c-4656-b024-bbe685c31060 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.653238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.654189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.654609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.655068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.656393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.661441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.661441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 206/408] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:23.661441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.681937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.739469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 203/409] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Sep 1 17:44:23 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:23.741052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfde83-bedf-4984-8349-804dcf221bd0 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.741400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfde83-bedf-4984-8349-804dcf221bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.741744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfde83-bedf-4984-8349-804dcf221bd0 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.748102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 204/410] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:23.748102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfde83-bedf-4984-8349-804dcf221bd0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.776601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bde-4c27-4c5f-9b98-624f6ad4bf1f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.818083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.819304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.822038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.822534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.823444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:23.823920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.825566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fbbb1-7c9c-47d3-991f-fa692bf04cdb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.827904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.837065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 207/411] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:23.840607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.841715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.842195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.863033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:23.865997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:23.907168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfde83-bedf-4984-8349-804dcf221bd0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:23.963488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 208/412] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:23.963488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:23.975249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:23.982111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:23.992135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:23.992135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:23.992135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:23.992135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:23.992135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:23.993461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 205/413] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:24.001028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.097102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6fcd0-0730-471d-b40c-8f7ed45d2b34 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.111747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f89eb-7408-47fb-b297-e3590ed8a2fb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.126795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:24.137846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] PATH_INFO: `/v3/groups/98bae3c6447140bdaa1ee13d12ad9035` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] RBAC: Authorizing `identity:get_group(group_id=98bae3c6447140bdaa1ee13d12ad9035)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20d9e-0ffb-44d4-8a62-95729605493a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:24.151989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 209/414] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:23 2022] GET /identity/v3/groups/98bae3c6447140bdaa1ee13d12ad9035 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:24.152388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652f5-434a-4ec7-97c4-03ffe398a560 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.152388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652f5-434a-4ec7-97c4-03ffe398a560 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.152388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652f5-434a-4ec7-97c4-03ffe398a560 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.152566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.152566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.152566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.152566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.152816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 210/415] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:24.152816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095652f5-434a-4ec7-97c4-03ffe398a560 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.154969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] RBAC: Authorizing `identity:create_grant(project_id=69e45e7543e043b8b177989dee9458fd, group_id=1c23fe0649044bb6a3cca02ff053a67f, role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:24.156909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b23b-f478-480c-9eaf-70d53a637704 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:24.226842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 206/416] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Sep 1 17:44:23 2022] PUT /identity/v3/projects/69e45e7543e043b8b177989dee9458fd/groups/1c23fe0649044bb6a3cca02ff053a67f/roles/af51edba370344dcadca2bd3e932b609 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:24.229805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.231077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.231741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.253873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:24.259269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:24.260921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:24.278809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095652f5-434a-4ec7-97c4-03ffe398a560 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.321405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.322351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.322844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.323289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] PATH_INFO: `/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.324747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] RBAC: Authorizing `identity:get_project(project_id=96c7134db2ce4630a56e3b2cec77b0cf)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:24.326504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:24.328543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 211/417] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:24.329788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.366946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 207/418] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:24.366946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.480336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c518a-5433-4b81-a368-b605771cc56e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.485098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fef2e-d189-475c-ac22-b4d54262ffd9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.503151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:24.522696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.523954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.524341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.524710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] PATH_INFO: `/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf/groups/98bae3c6447140bdaa1ee13d12ad9035/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.525756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.526385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.526613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c7134db2ce4630a56e3b2cec77b0cf, group_id=98bae3c6447140bdaa1ee13d12ad9035, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:24.526717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.526994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.528108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:24.543087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:24.548837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:24.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:24.551508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 212/419] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:24.555958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.566350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:24.590340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 208/420] 10.222.0.58 () {58 vars in 1442 bytes} [Thu Sep 1 17:44:24 2022] PUT /identity/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf/groups/98bae3c6447140bdaa1ee13d12ad9035/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:24.693718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e105-a3c7-44c3-8711-a03d1d56f076 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.748955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.749558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.749833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.750102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.750795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:24.751097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:24.752489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:24.766896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 213/421] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:24.770031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.772297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:24.883643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:24.924322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd105de-c2e7-45cd-8fb3-410f050ebde3 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.924769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329411-bfc7-4f4b-bca8-3ba7b9feb3a3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:24.964103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.964811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.965163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.965509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.967789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:24.968595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:24.968876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:24.969146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:24.982245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:24.988445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:24.989405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:24.990654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 209/422] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:24.997355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.027481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.109302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9634e8-0019-49ac-83c8-928446809043 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.148116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.149644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.155133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.155743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.156016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.156281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.156944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:25.157241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.158578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.171325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 210/423] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:25.180287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.278621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.288477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.296397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241cf0a-f32a-46c9-a6c8-59c4afddacb7 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.337190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.337946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.338232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.338502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.360129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 214/424] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:25.365942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.462153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.463528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.490458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1d26-52a4-4de5-ba34-4ddef0d03c5b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.552151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.554526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.555355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.556811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.559748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.562601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.569017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 215/425] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:25.571861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.619285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.638253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 211/426] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:25.646755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.658245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.721328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8889e6-0df6-4254-b3d7-b15f3839457b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.771403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.772026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.772300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.772566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.774402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.775976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.777588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 216/427] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:25.784575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.858285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802857d-5777-47d0-8153-29fee411c209 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.936507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.937150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.937422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.937689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] PATH_INFO: `/v3/projects/7502ee0d26ee49a894884736dc09b0ca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.939493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] RBAC: Authorizing `identity:get_project(project_id=7502ee0d26ee49a894884736dc09b0ca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.940933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:25.945525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 212/428] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/projects/7502ee0d26ee49a894884736dc09b0ca => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:25.948386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a615d-2ace-4d69-a1a0-45b1574fafee None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:25.950649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:25.953456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:25.995627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:25.996136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:25.996416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:25.996688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:25.997428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=7502ee0d26ee49a894884736dc09b0ca) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:25.997739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:25.999234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7197595-b100-4342-839c-4ddde35314b6 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:26.005710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 217/429] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:26.007009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea68c6f-1a19-4058-bba1-9cf3556663f8 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.007291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea68c6f-1a19-4058-bba1-9cf3556663f8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.007731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea68c6f-1a19-4058-bba1-9cf3556663f8 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.011836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 218/430] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:26.015196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.015477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.015750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.030476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:26.036929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:26.038407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:26.144833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ffc9-3bdb-42b7-be10-8991a24f141e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:26.167164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 219/431] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:26.217506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:26.218144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.218421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.218691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.219900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:26.221330 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:26.222927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 213/432] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:25 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:26.229554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:26.370394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:26.374371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62463250-e625-4b43-9bf9-b3582e53d917 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:26.417780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:26.418444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.418720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.419033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.419766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=7502ee0d26ee49a894884736dc09b0ca) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:26.420068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:26.421512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b086-4a4c-4af9-95fd-98912de4b00f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:26.430075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 220/433] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:26 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=7502ee0d26ee49a894884736dc09b0ca&role.id=af51edba370344dcadca2bd3e932b609 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:26.493695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:26.615170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56ad6-baf1-40d6-beab-1ad6efd9e660 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:26.635925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e88a-19c6-4d3c-9762-520aa465ce6b None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.641819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e88a-19c6-4d3c-9762-520aa465ce6b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.641819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e88a-19c6-4d3c-9762-520aa465ce6b None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.641819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 221/434] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:26.642077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:26.646916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.647465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.648140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.659344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:26.659985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.660256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.660522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.673361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:26.674555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:26.675820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:26.681944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:26.683086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:44:26.683900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:26.686950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 214/435] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:26.692991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:26.782928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 222/436] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:26.824209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243a7b-69a4-4e13-8a9e-fd626dbc8d1b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:26.860517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:26.861141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:26.861397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:26.861663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:26.862336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] RBAC: Adding query filter params (name=member) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:26.862638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:26.864035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e7a57-b725-4ec6-8d75-7765595cb108 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:26.873748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 215/437] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:26.879409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:26.990365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:26.999737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fe951-02b2-4748-88ba-37c366a47a84 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.008271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697629d-abf9-4427-bd1d-dfbb8019da96 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.008554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697629d-abf9-4427-bd1d-dfbb8019da96 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.008838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697629d-abf9-4427-bd1d-dfbb8019da96 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.010421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 216/438] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:27.015434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.015716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.015990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.038106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:27.038785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.039465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:27.039810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.040208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.040594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.083902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.109322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 217/439] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:27.110129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.111288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.112742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.203078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.223718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 223/440] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:27.223877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bbe3f-1ece-4537-b059-cb08e01f286e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.223981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.256641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.257082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.257386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.257668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.267993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:27.272915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:27.273827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:27.274657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 218/441] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:27.280462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.322280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.329118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7db0-cf4c-4a33-8a66-bb19c21325a4 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.365612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.366379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.366590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.367485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.368616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.370050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.371870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 224/442] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:27.377071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.393950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36162-e6ff-4d44-9c10-a8e2d6c85262 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.427675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.428275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.428553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.428822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.430170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:27.430677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.432060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.437610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.440085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 219/443] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:27.443655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.480627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c444da-c9c1-4ad0-ba6c-375289e90bbf None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.514964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.515602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.515862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.516131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.517268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.518748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.520325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 225/444] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:27.521160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.544005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.549696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c89d-2316-4777-b151-41c66cd13b30 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.582829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.583462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.583743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.584014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.594492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:27.599923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:27.600957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:27.602544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 220/445] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:27.603244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.659535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e5be8-a727-4426-8202-60cac595a25b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.685957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.693311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.693909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.694185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.694462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.701853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4ada-ecea-450b-8ff3-d5ca2103ca38 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.734991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.735522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.735794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.736059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.736772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=cee4828f017b4ac7a91a87c02aef60b9, scope.project.id=69e45e7543e043b8b177989dee9458fd) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:27.737089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.738503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.744364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 221/446] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=cee4828f017b4ac7a91a87c02aef60b9 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:27.745143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.770838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:27.781868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.783431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.855769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b1fe-e949-4f75-82a6-f6e33bbdfa76 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:27.893862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:27.902858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:27.903138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:27.903408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:27.904123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:27.904427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:27.905808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:27.910800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 226/447] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:27.912952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.915830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 222/448] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:27.921557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:27.944891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.028438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0784e3-51ea-4474-a0c9-32fbf176718d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.031974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.056936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a57f9-6422-4f75-9f4a-a48a4c8893fb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.074083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.074711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.075015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.075288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] PATH_INFO: `/v3/projects/69e45e7543e043b8b177989dee9458fd` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.076912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] RBAC: Authorizing `identity:get_project(project_id=69e45e7543e043b8b177989dee9458fd)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.077862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.079678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 227/449] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/projects/69e45e7543e043b8b177989dee9458fd => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:28.085003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:28.097032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.097655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.097926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.098194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.167030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.168474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.183974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.190282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3408e-997e-46a7-a543-6a437a95a267 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.224920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.225643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.225990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.226391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] PATH_INFO: `/v3/groups/1c23fe0649044bb6a3cca02ff053a67f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.227562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] RBAC: Authorizing `identity:get_group(group_id=1c23fe0649044bb6a3cca02ff053a67f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.229022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.230598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 228/450] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:28 2022] GET /identity/v3/groups/1c23fe0649044bb6a3cca02ff053a67f => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:28.236353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:28.247820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.266999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 223/451] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:28.272579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:28.337951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc0344-01be-42d1-be65-4ad6cc055e14 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.373735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.374341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.374672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.374979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.375710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] RBAC: Adding query filter params (group.id=1c23fe0649044bb6a3cca02ff053a67f, role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=69e45e7543e043b8b177989dee9458fd) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:28.375832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb34a8-dd00-4218-a089-f43a80226a76 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.376018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.377457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.383741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 229/452] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:28 2022] GET /identity/v3/role_assignments?group.id=1c23fe0649044bb6a3cca02ff053a67f&scope.project.id=69e45e7543e043b8b177989dee9458fd&role.id=af51edba370344dcadca2bd3e932b609 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:28.412469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.413115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.413392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.413699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] PATH_INFO: `/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.415668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] RBAC: Authorizing `identity:get_project(project_id=96c7134db2ce4630a56e3b2cec77b0cf)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.417128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.418862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 224/453] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:44:28 2022] GET /identity/v3/projects/96c7134db2ce4630a56e3b2cec77b0cf => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:28.424520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:28.456272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.531885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1cc34-6e02-4e4d-8cfe-960cf65af452 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.566833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.567472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.567752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.568058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] PATH_INFO: `/v3/groups/98bae3c6447140bdaa1ee13d12ad9035` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.569211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] RBAC: Authorizing `identity:get_group(group_id=98bae3c6447140bdaa1ee13d12ad9035)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.571619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7735fd3-a918-4aac-936f-df711094b55f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.573221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 230/454] 10.222.0.58 () {56 vars in 1180 bytes} [Thu Sep 1 17:44:28 2022] GET /identity/v3/groups/98bae3c6447140bdaa1ee13d12ad9035 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:28.579115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:28.631391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:28.683938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7b89-6395-479d-bac1-d596609a8f45 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:28.719422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:28.720027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:28.720308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:28.720583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:28.721311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] RBAC: Adding query filter params (group.id=98bae3c6447140bdaa1ee13d12ad9035, role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=96c7134db2ce4630a56e3b2cec77b0cf) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:28.721618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:28.723103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b51ff-aa97-467c-842a-af5179fc28e5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:28.731119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 225/455] 10.222.0.58 () {56 vars in 1376 bytes} [Thu Sep 1 17:44:28 2022] GET /identity/v3/role_assignments?group.id=98bae3c6447140bdaa1ee13d12ad9035&scope.project.id=96c7134db2ce4630a56e3b2cec77b0cf&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:30.975489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdb39-d40f-496d-92ad-f69b73a0646d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:30.976541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdb39-d40f-496d-92ad-f69b73a0646d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:30.976541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdb39-d40f-496d-92ad-f69b73a0646d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:30.978157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 231/456] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:30.983413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e9e25-2abf-44ac-9bd0-205b89eb1d99 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:30.984213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e9e25-2abf-44ac-9bd0-205b89eb1d99 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:30.984711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e9e25-2abf-44ac-9bd0-205b89eb1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.007961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-571e9e25-2abf-44ac-9bd0-205b89eb1d99 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:31.009468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-571e9e25-2abf-44ac-9bd0-205b89eb1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:31.096873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 226/457] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:31.238003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b98d6-b5bc-4923-89bd-da52ca6fbb1a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.238631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b98d6-b5bc-4923-89bd-da52ca6fbb1a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.239120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b98d6-b5bc-4923-89bd-da52ca6fbb1a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.241147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 232/458] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:31.247950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d6cd-6311-4dc4-bc83-c4daa2d02f72 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.248515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d6cd-6311-4dc4-bc83-c4daa2d02f72 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.249013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d6cd-6311-4dc4-bc83-c4daa2d02f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.270523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0e81d6cd-6311-4dc4-bc83-c4daa2d02f72 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:31.272052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0e81d6cd-6311-4dc4-bc83-c4daa2d02f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:31.336597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:31.383493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 227/459] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:31.528907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b98d6-b5bc-4923-89bd-da52ca6fbb1a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:31.634511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99af42-a2d9-4165-a31e-d59ca9041f8e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.635166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99af42-a2d9-4165-a31e-d59ca9041f8e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.635637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99af42-a2d9-4165-a31e-d59ca9041f8e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.637435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 228/460] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:31.643909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.644484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.644949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.667889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:31.669416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:31.685648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:31.693115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b98d6-b5bc-4923-89bd-da52ca6fbb1a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:31.730778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:31.731638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.732061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.732513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.744181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:31.745944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:31.758819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 229/461] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:31.760512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:31.774868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:31.775872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:31.776726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:31.776726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:31.776726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:31.778645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 233/462] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:31.786935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:31.903854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2a9f-f0ad-4f9f-b9b2-f9140ba62296 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:31.918065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abeb40-54b9-4c98-8b2a-9842ba0fb53d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:31.921238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:31.951878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:31.952642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.953040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.953467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.954214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:31.954662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:31.956334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32440ae-1ea3-4763-a868-21722dbcecb0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:31.970145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 234/463] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:31.971757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297056-b60d-4680-8cd3-f9ec8ad22603 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.972155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297056-b60d-4680-8cd3-f9ec8ad22603 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.972295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:31.972643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297056-b60d-4680-8cd3-f9ec8ad22603 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.973254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:31.973698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:31.974112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:31.974366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 235/464] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:31.980051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297056-b60d-4680-8cd3-f9ec8ad22603 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:31.991247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:31.994548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:31.995708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-a0f3dbef-adaf-445d-bb4f-519b03fea544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:32.019761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:32.021007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:32.021912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:32.021912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.021912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:32.023984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 230/465] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:32.025462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.025946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.026418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.047531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:32.049125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:32.101816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297056-b60d-4680-8cd3-f9ec8ad22603 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.126889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 231/466] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:32.126889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.140557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.141360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.141817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.142090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.142769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.144226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.224137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.239359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7191f9-3bfb-426a-94c4-5e431bfd126d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.274448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.275345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.275769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.276186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.277087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:32.277662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.279285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.284272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 236/467] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:31 2022] POST /identity/v3/users => generated 246 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:32.285309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.295458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 232/468] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:32.300982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.367442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.428473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6535f-78e1-4ad4-9c79-bcad7fe7f756 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.438355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb6470-945d-485c-8c95-e7761493baee None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.467461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.468465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.468969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.469412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.482124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.483938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.485770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.486564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.486891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.487168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.488167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.489707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:32.501601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:32.502627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:32.503517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:32.503517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.503517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:32.505444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 237/469] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:32.511784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.591011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 233/470] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:32 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:32.592150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.595082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.636715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2618-b468-4024-a030-743a41ff4b7a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.667796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.687720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.688434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.688772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.689105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.689889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:32.690881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.694383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.709974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 238/471] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:32.716850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.725147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6b3e-4d38-42de-93b9-9f190f64809b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.775021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.775862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.776714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.777154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.793311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.795273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:32.818668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:32.820390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:32.821424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:32.821424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:32.821424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:32.823381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 234/472] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:32.830152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:32.857498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc38b-fdcc-4005-9899-ff60601d1c25 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.897361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.912013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:32.913064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:32.913064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:32.913733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:32.914274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:32.916217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351309e-6fbb-42fb-a1d9-6952636ca5ee None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:32.957292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a62e31-8abc-4183-b629-71460fe0c45e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:32.999962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:33.000582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.000836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.001101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.001738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:33.002055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:33.003445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89a511-ae2f-4536-ab12-a317bd2591b6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:33.016725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 235/473] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:33.017729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b77-19bb-44f7-8042-d757987d0b01 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.018010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b77-19bb-44f7-8042-d757987d0b01 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.018278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960b77-19bb-44f7-8042-d757987d0b01 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.019651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 236/474] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:33.023515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960b77-19bb-44f7-8042-d757987d0b01 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:33.063007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 239/475] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:32 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:44:33.063007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.063007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.063007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.093887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:33.096985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:33.159258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:33.194335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 240/476] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:33.209287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960b77-19bb-44f7-8042-d757987d0b01 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:33.225684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:33.248272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:33.248961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.249245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.249514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.250173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:33.251750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:33.398077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 237/477] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:33 2022] POST /identity/v3/users => generated 249 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:33.511661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:33.651608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fe9eb-2927-4644-ab4e-4c1acbe0b033 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:33.688110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:33.688717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.688996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.689266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.689940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:33.691352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:33.738014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.sql.core [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:44:33.738014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 17:44:33.738014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [parameters: {'id': '6ad68e65b11d484d90d2b16a51282344', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 17:44:33.738014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81628) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application result.read() Sep 01 17:44:33.757123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:44:33.760869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application yield resource Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise self.value Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application session.commit() Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:44:33.761865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:44:33.762802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:44:33.763710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application result.read() Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:44:33.766039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [parameters: {'id': '6ad68e65b11d484d90d2b16a51282344', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:33.771181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 17:44:33.772304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:33.774850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 241/478] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Sep 1 17:44:33 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:33.774984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:33.887207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa6c-3e10-4dc0-be8a-c3551f633a71 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:33.934250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:33.937800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:33.937800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:33.937800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:33.951780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-675ac9a4-b8ce-49b0-bcef-e888a51367d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:33.961623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:33.962711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:33.963893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 238/479] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:33.968407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:34.018357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:34.114337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e291-2655-4b7e-a61d-148af3a6a85c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:34.166532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:34.167190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:34.167467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:34.167739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:34.168412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:34.168711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:34.170082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f32db-1529-4281-a729-45dd1a04701a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:34.178884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 242/480] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:34.907873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9abf3-f20b-4002-a2ef-ece202f4b5ba None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:34.907873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9abf3-f20b-4002-a2ef-ece202f4b5ba None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:34.907873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9abf3-f20b-4002-a2ef-ece202f4b5ba None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:34.907873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 239/481] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:34.919123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:34.919123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:34.919123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:34.952271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:34.953787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:35.022192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9aa2-0e88-4728-91bc-c841684d7f13 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.022557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9aa2-0e88-4728-91bc-c841684d7f13 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.022773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9aa2-0e88-4728-91bc-c841684d7f13 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.024628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 240/482] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:35.046772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.046772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.046772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.049987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 243/483] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:35.091742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:35.092932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:35.118578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:35.177059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 241/484] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:35.359682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:35.381222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:35.484853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcf92-eca8-433d-807b-93f90c96bf8f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:35.527806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:35.528430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.528701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.528967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.541739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f05b5e3e-17a8-4e5d-acdc-1f7f5d56d002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:35.550886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:35.551788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:35.552611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:35.555577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 244/485] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:35.561685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:35.636791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fe85b-94e5-48dc-86fe-154869b9ac3e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.637398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fe85b-94e5-48dc-86fe-154869b9ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.637889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fe85b-94e5-48dc-86fe-154869b9ac3e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.639691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 245/486] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:35.644694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.645206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.645678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.675244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:35.676791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:35.701312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f4c90-e2a3-420a-803f-6075e12f2875 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:35.739573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:35.739573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.739573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.739895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.740479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:35.740776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:35.743344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:35.753050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 242/487] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:35.753776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:35.770249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 246/488] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:35.771521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:35.807667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:35.834681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:35.957395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c84d9-91e3-48d1-8944-fb3db5c0835c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:35.960335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad38b5-e094-435d-8d5c-0dc98b92b5e8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:35.994976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:35.995530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.995811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.996053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:35.996169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:35.996829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:35.997122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:35.997456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.008330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.009413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:36.009775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8d113650-4dcf-42ca-a73a-77a7ff3adc51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:36.014405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.015525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.016547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:36.017859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 243/489] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.022766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d917b-8354-4ace-b619-95d796bd10fe None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.022766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d917b-8354-4ace-b619-95d796bd10fe None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.022766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d917b-8354-4ace-b619-95d796bd10fe None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.022766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 244/490] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:36.025002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d917b-8354-4ace-b619-95d796bd10fe None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-9e650963-cce9-4dcc-9aaf-59eb06878621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:36.032204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.033963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:36.035999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:36.035999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:36.035999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:36.035999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 247/491] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.039753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.039753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.039753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.063608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:36.065858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:36.124953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.128439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.151006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 248/492] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:36.151006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.152788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d917b-8354-4ace-b619-95d796bd10fe None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.199669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.200539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.200869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.201381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.202464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:36.202793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.204156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.215998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 245/493] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:36.217092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.266386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c278d5a-e6ed-4c0f-9d1f-f923f4bf5a07 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.306125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.306750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.307029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.307446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.308096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:36.308392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.310086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.321997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 249/494] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:36.322852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.358059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6686bbe-e385-49c1-8c70-659dac116cc6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.387871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.395609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.396390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.396737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.397100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.408872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:36.414821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.415903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.416909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:36.418517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 246/495] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.419533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.424267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.455853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a253c4a-fe86-4984-a177-9b0b1727db34 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.496418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.497285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.497707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.498130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.510474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.512145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:36.527789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.528879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:36.529882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:36.529882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:36.529882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:36.531303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 250/496] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.532216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.543569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc8ec-840d-4306-a377-74af14b4ce0d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.580186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.580827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.581109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.581701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.590431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.591889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:36.604608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.605546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 247/497] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.611320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.651033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcb58c-2719-4e34-81e3-76baf38d5c08 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.652761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.675784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.691459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.692074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.692463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.692735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.693394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:36.693695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.695211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.703647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 251/498] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:36.704436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.720644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba08f9-6911-4bad-8dd4-4a082d53b34e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.764847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.765970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.766466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.766909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.778021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:36.783344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:36.784300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:36.785109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 248/499] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:36.785830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.808713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8e745-b953-49aa-b9a1-84513489fa58 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.842019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.842615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.842921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.843189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.843819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:36.844115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.845479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.857183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 252/500] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:36.857977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:36.883314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.887628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaffca-e1fe-41ba-9281-06878d363478 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.909742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.920146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:36.920744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.921029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.921298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.922028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:36.922337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:36.923827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038c4b-2b5f-4083-a7aa-7cf66dee9a6c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:36.965105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 249/501] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:36.966205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220ac-b2a8-4e33-b9cf-85d19ccba66d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:36.966494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220ac-b2a8-4e33-b9cf-85d19ccba66d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:36.966793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1220ac-b2a8-4e33-b9cf-85d19ccba66d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:36.967457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2683f-5a7f-4e65-95ea-16570a41f3de None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:36.968117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 250/502] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:36.968684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1220ac-b2a8-4e33-b9cf-85d19ccba66d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.006089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.006708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.007029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.007339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.017706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.019263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:37.033790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.034775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:37.035662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:37.035662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.035662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:37.035662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 253/503] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.035662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.073959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1220ac-b2a8-4e33-b9cf-85d19ccba66d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.108607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.109208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.109484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.109753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.110413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:37.110712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.112103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfc6b8-f51c-4351-a3d3-02ff6a126ead None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.112496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.120655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 251/504] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:37.128228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.128228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.128228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.135492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c74b9-19a2-4305-86dd-a87374f0d5b8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.141757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:37.143038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:37.169534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.170141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.170421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.170692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.178038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.180110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.183495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:37.193113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.197336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 254/505] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.198497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.212877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 252/506] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:37.213708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.315935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9642e-b0bc-4c2b-9378-b7bd40516e64 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.323815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b743fb-31cc-4b90-8531-6f089406de1f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.354687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.355321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.355597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.355867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.356507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:37.356818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.358179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.361423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.362023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.362299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.362567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.367045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.377611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 253/507] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:37.377611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.413740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.441776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.443369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.485161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b91ce-8f9f-4474-8f50-8d6702447f32 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.520142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.520766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.521038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.521305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.532360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.533820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.543275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 255/508] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:37.544202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:37.548273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.549185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:37.550369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:37.550369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.550369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:37.550369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 254/509] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.550369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.585324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.634721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.648659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582ba3-ac73-4f05-b399-a6ce1ee0a0d1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.651549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5533-d8e1-4c23-a803-42032cc7c72d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.686416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.687069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.687341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.687608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.688340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:37.688645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.690364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.693206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.693840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.694121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.694394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.702313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.703794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:37.715239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.716160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 255/510] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.717101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.745554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 256/511] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:37.746444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.825018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b68078-1fcf-4f7b-8d2a-12709cb5c5f0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.842787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.849263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa46a-680e-41f7-87f0-fc57d6137e36 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:37.858189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.858846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.859125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.859397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.870761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.872203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.878458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:37.884721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:37.885352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:37.885629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:37.886083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:37.887536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.888408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:37.889278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:37.889278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.889278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:37.889278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 256/512] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.889492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.898372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:37.899861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:37.914768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:37.915724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:37.917001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:37.917001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:37.917001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:37.917001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 257/513] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:37.917297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:37.995520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bce4-05ec-4e12-a85a-31e94da296fb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.019460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3f5f-f692-426c-8761-aa5144de5a28 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.028984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.029587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.029861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.030127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.030780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:38.031081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.032432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.045019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 257/514] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:38.046019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.062987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.063636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.063918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.064187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.064929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:38.065232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.066677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.089408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 258/515] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:38.090327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.094073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.119595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.160255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471b43-2ad3-44ad-ada3-26e649130d22 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.194156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.195407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.195840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454a3dc-bd49-4243-a4cf-78bf183f9254 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.195985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.196264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.229832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.230438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.230708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.231002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.231633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:38.231929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.233301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.245172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 259/516] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:38.245940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.266213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.267692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.309243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.323564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.347706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53110ce7-a3b7-4c7a-953f-3d93886b2b68 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.363947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 258/517] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:38.364767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.383244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.383875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.384110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.384374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.385017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:38.385314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.386707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.398609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 260/518] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:38.399327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.475702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e9f3-8750-4598-89f9-8d1e68574f0f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.509597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191da670-c940-4184-bff4-23bfdd49bafd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.512085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.512785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.513070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.513335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.520435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.521878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.533796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:38.534409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:38.535510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 259/519] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:38.536612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.550395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.551039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.551313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.551586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.556100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.619467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.620857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.640446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6680-dcd4-4fe5-be69-59f8d21f20ce None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.674122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.674720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.675022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.675289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.675917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.677340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.718846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 261/520] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:38.719749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.745220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.758782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 260/521] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:38 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:38.758782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.841873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:38.843585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156090d-4fee-46f9-9d97-26af8ea1cf60 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.870611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd173af-a8fe-405d-9401-d9c25e284cc6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:38.881489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.882362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.882709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.883026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.895873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.898769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.910445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:38.911311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:38.911545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:38.911627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:38.914395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:38.915448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:38.916439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:38.916439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:38.916439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:38.916839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 262/522] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:38.917635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:38.922142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:38.923643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:38.938162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:38.939341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 261/523] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:38.940303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.023022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.050659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cc3cd-6ce1-49f8-b49c-ddbce30e1a7f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.061596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b006d-d479-4bf7-baac-d4250e766370 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.089998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.091018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.091434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.091875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.092748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:39.093303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.095043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.098434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.099093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.099367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.099635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.101967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.110928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.112457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.118495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 263/524] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:39.119585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:39.131298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:39.132323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:39.134103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:39.134103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:39.134103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:39.134103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 262/525] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:39.134103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.239628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927d05d-4f24-46ec-9d0b-45fe0fc64539 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.246708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00328c-fe04-42b8-82ed-c03926f69de0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.275770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.276368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.276643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.276909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.277542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:39.277839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.279731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.281324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.284479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.285110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.285428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.285737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.286972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:39.287323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.289484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.296352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 264/526] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:39.297420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.314384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 263/527] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:39.314384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.364252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.415346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6573f18-089e-43f2-801e-b2d5f4598693 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.421015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621924-7483-4f63-8611-8e40d153d889 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.449214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.449832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.450110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.450382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.458240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.459134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.459566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.459986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.460914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:39.461219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.462721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.480275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 264/528] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:39.480970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.514311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.522199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.524199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.586324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa16d-9c99-4848-8b6c-6014e346aac2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.593286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.621444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.622156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.622434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.622705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.629438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 265/529] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:39.629662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.631139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.635051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:39.642887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:39.643795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:39.644685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 265/530] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:39.645170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.741628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.749089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902459f-4fd3-412e-8faa-5bbe245c1c25 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.751697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7ff9-4e97-4b4f-b8d4-7d9cadcb814f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.784768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.786072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.786707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.787453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.788361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:39.788916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.790351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.806753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 266/531] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:39.807066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:39.807165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.807256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:39.807256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:39.807256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:39.816460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:39.818039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:39.832047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:39.833008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:39.833881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 266/532] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:39.834353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:39.871205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.969035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5c11-8195-4405-a055-c6307583a40b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:39.996011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3513b3-9472-46e2-9676-2945c97c2c54 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.021462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.022578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.023930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.024382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.038196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.041306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.049701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.050411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.050784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.051191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.052037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:40.052413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.054817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:40.065936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:40.067199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:40.068059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:40.068059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:40.068059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:40.068059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 267/533] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:40.068059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.081389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 267/534] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:40.087356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.103116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:40.200033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:40.206532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd2317-c682-4305-8bb5-821dd6e87920 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.217140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3917e-f77e-41ca-9ef8-1e922fe6fc0d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.261081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.261366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.261872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.262154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.262427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.263185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:40.263491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.263920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.264704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.264955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.265684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.267491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:40.268081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.269934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.290150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 268/535] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:40.290150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.293272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 268/536] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:40.294334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.389299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:40.434322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2abd1-15bd-49a9-9787-3ae34dbadf5a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.441673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693895fd-eef2-4b8c-ac53-8b72ba23b695 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.480040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.480730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.481008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.481279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.482210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=e162ed7a337a40f5875048254f16a2ce) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:40.482315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.483760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.487907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.488942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.489392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.494766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.494938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 269/537] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/role_assignments?user.id=e162ed7a337a40f5875048254f16a2ce&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:40.494938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.496063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=55c40c8bb3b24e07b3189f84acd4ca02) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:40.497421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.505387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.521567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 269/538] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/role_assignments?user.id=55c40c8bb3b24e07b3189f84acd4ca02&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:40.536605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:40.667233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f1d-68a9-46a9-ba16-660f46b78ace None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:40.724280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:40.725238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.726502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.726983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.741911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:40.744566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7466cef1-6270-4e92-9201-a0bb3e9d1d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:40.764401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:40.766014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:40.767409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 270/539] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:40.776381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:40.854748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ecc1-45f2-4da8-8f88-2cbdafccc333 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.855119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ecc1-45f2-4da8-8f88-2cbdafccc333 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.855348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ecc1-45f2-4da8-8f88-2cbdafccc333 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.860702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 271/540] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:40.862475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:40.867112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:40.867112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:40.885334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:40.886421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:40.967327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102e4b0-3761-4b88-9ed4-3b29bc3a6a9b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:41.023585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:41.023585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:41.023585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:41.023585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:41.024025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:41.024025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:41.024025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:41.027138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:41.035123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:41.050869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 272/541] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:41.056434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 270/542] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:41.062514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:41.198516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0ad9-3f50-431d-9b1f-407c5aa68ae9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:41.245400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:41.246018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:41.246296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:41.246563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:41.247326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=9ae3b9603f0b45cebed05cdeb0d50be9) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:41.247632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:41.249069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:41.259037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 273/543] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:41 2022] GET /identity/v3/role_assignments?user.id=9ae3b9603f0b45cebed05cdeb0d50be9&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:41.365541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:41.478265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbca8-8614-4d3c-a926-cce38a93a524 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:41.518921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:41.519555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:41.519826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:41.520094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:41.531176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:41.536059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:41.536945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:41.537751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:41.542468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 271/544] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:41.543888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:41.648231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:41.688751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5685-585c-4a0c-b5a4-8f170187a3b6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:41.724634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:41.725302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:41.725583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:41.725961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:41.726693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:41.727028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:41.728417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:41.737083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 274/545] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:41.742718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:41.824725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:41.872534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b05fc-4567-419d-b078-a604cb33b320 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:41.908790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:41.909340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:41.909613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:41.909876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:41.924585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:41.926063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:41.951335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:41.952338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:41.953296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:41.953296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:41.953296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:41.953911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 272/546] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:41.958579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:42.106380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52b220-1d52-4ac2-aa37-7fe99dd8bc56 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:42.137429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:42.150208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:42.151086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.151929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.152415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.153199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:42.153637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:42.155165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f222aea-deef-4ef8-88ab-3acfb740a151 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:42.173277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 275/547] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:42.179554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:42.239825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88a9d-2071-44e9-b4be-c72a84d4bfbd None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.240338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88a9d-2071-44e9-b4be-c72a84d4bfbd None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.240338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88a9d-2071-44e9-b4be-c72a84d4bfbd None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.242687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 276/548] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:42.247773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.248054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.248324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.266933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:42.268132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:42.348185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20197-c8bb-48c4-a848-9677e5a2a850 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:42.358837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 277/549] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:42.361168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:42.396767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:42.397398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.397707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.398035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.405845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:42.407333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:42.419445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:42.420348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:42.421267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 273/550] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:42.426292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:42.564372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1579c9-89c5-4826-9e4a-4e6dcf2256ea None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:42.582025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:42.601737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:42.602536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.602835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.603093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.603837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:42.604140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:42.605580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:42.628413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 278/551] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:44:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:42.629758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:42.701247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:42.746417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d7d7-2133-47fa-8474-268adf1fcbb1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:42.851995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:42.852611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.852888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.853161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.854779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc822ef-fa87-4c75-b290-23b2928e287a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:42.903798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:42.904429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:42.904705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:42.904969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:42.917597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:42.928127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:42.934276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:42.936744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:42.937572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 279/552] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:42.944314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.000024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.001494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756254-b4b3-4812-95fc-39e170beacb5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.009708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.131629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3366-df6d-4c64-b454-e8daf97540f4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.186191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.186858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.187146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.187415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.188208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:43.188616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.190005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf95a7-a116-40b9-81cb-8c1628b39ec8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.196890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 274/553] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:43.199226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f690ec-7705-4c60-8965-5783e6559145 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.199519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f690ec-7705-4c60-8965-5783e6559145 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.199795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f690ec-7705-4c60-8965-5783e6559145 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.201839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 275/554] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:43.202660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f690ec-7705-4c60-8965-5783e6559145 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.209661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 280/555] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:43.211169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.211516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.211794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.234168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:43.235606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:43.278648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.319789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f690ec-7705-4c60-8965-5783e6559145 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.329210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 281/556] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:43.330647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.361957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.367265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.367961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.368160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.368425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.381025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.382538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-22f87925-808c-47f7-b082-f8a8ac2b10d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:43.397312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:43.399077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:43.399980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:43.399980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:43.399980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:43.399980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 276/557] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:43.400622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15005-ecf1-467b-a3f6-7d814a1fcd55 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.400779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15005-ecf1-467b-a3f6-7d814a1fcd55 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.401047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15005-ecf1-467b-a3f6-7d814a1fcd55 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.406380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 277/558] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:43.407187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15005-ecf1-467b-a3f6-7d814a1fcd55 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.466805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fb9f-2e7b-466f-9cd1-8db5a818400e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.505784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.506456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.506833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.507381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.517823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.519311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b7747d3e-62ea-4517-9eab-6cb68dd63a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:43.535189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:43.536248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:43.537174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:43.537174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:43.537174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:43.537174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 282/559] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:43.538913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abcac-3c01-4b29-bbf5-ce854918d7e1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.539333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15005-ecf1-467b-a3f6-7d814a1fcd55 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.539634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abcac-3c01-4b29-bbf5-ce854918d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.540151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2abcac-3c01-4b29-bbf5-ce854918d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.559268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-dd2abcac-3c01-4b29-bbf5-ce854918d7e1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:43.560858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-dd2abcac-3c01-4b29-bbf5-ce854918d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:43.561928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.584721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.586192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.586885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.587762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.588862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:43.589338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.592585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.607852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 278/560] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:43.609062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.634523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 283/561] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:43.635869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f740ac-6462-4d35-bbec-2b34711d199f None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.636158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f740ac-6462-4d35-bbec-2b34711d199f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.636434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f740ac-6462-4d35-bbec-2b34711d199f None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.637657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 284/562] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:43.638404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f740ac-6462-4d35-bbec-2b34711d199f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.649745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.718696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26eba-5949-49e9-9500-6fda75e95a67 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.747384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f740ac-6462-4d35-bbec-2b34711d199f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.754298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.754984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.755264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.755535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.756231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:43.756533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.758501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.775820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 279/563] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:43.776654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.784906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.785527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.785800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.786064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.793070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:43.794492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7a799be9-8144-4a97-8bb4-ef6ad4f99158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:43.805672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:43.806576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:43.808141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 285/564] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:43.808706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.808706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.808834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.825698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.828311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:43.829490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:43.890338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786ae5-5030-451c-8764-b9a37260006d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:43.894135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:43.900004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 286/565] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:43.907614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:43.927077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:43.927701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:43.927975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:43.928240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:43.941335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:43.947426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:43.948379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 280/566] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:43.949234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.018863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3af7c-3a44-4157-be87-797aed476000 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.051051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.053123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.053756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.054520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.054821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.055411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2670b-e7c3-418a-b359-ef7de88cfe02 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.063009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.064444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:44.077574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.078572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:44.079810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:44.083326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 287/567] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.084326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.096521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.097530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.097870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.098205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.099010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.099382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.100921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.112753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 281/568] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.113605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.150276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.193440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f7670-ddf9-445b-a32b-19fad9428e1c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.215838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282ed3-8966-4f0e-9c45-ad3136d36548 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.226789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.227421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.227699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.227966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.237886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:44.243820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.244785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 288/569] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.245643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.249596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.250208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.250480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.250774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.251417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.251707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.253070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.261757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 282/570] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.262539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.284019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.348046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd473020-3b07-4cbf-a15f-539d6ef5e197 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.360580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29945-cafb-4a33-bb8d-8b1207203a1c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.364433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.381542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.382744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.383121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.383348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.384068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.384366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.385802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.394986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.395588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.395864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.396133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.396859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=86f47c546d1b47d69252eaa11b5a3f24) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.397167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.398621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.403782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 289/571] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.410490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 283/572] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/role_assignments?user.id=86f47c546d1b47d69252eaa11b5a3f24&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.410691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.410810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.516436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.533178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e114c-a486-4bb8-821d-a8fd3fafcfa8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.534529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5ba4-a4a7-46cc-a6d5-aea3530ab98f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.573606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.574217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.574494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.574791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.575457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.575756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.577133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.584763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.585407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.585687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.585957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.590603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 284/573] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.591697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.599488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:44.604886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.606017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 290/574] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.607224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.644185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.709203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213f6ce-1f14-41c1-a792-ea832f6eb525 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.713951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc331-5a0a-494e-b275-5e3bff7169c8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.748288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.748916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.749239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.749447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.752208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.752769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.753053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.753326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.760782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.762289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.764021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.765451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.769281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:44.777419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.778387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:44.779319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:44.779319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.779319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:44.781017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.781955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:44.788842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:44.788842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.788842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:44.788842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 291/575] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.789107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 285/576] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.789180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.789249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.916537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:44.919817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578cc0-987e-4c18-8999-d43428868e43 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.928334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48207b29-c32d-4f2d-8c69-7f9d56fc054f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:44.961923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.962682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.962990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.963292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.963921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:44.964220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.965598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.967495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:44.968612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:44.969101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:44.969548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:44.978246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 286/577] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:44.978246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:44.980585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:44.982179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:44.997424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:44.998404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:44.999366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:44.999366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:44.999366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:44.999366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 292/578] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:44.999366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.048212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.095110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e599b-cd99-4af9-b415-c8dfa20363a1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.113476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904a59-b182-4a4f-bae2-17ed2de7c105 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.134755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.135714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.136057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.136545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.137571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.138209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.140147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.147802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.148395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.149135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.149409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.150042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.150341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.152172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.155338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 287/579] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.156462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.160958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.164153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 293/580] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.164999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.266479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622b9f3-39d1-48d3-8304-f12a770d0c7a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.271416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ec29-9f70-407b-8387-925044d07c94 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.287942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.302451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.303038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.303313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.303586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.309014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.309957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.310293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.310616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.311341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.312002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.313123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.315403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.316872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.329371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 294/581] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.329371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:45.337945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:45.339324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:45.340414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:45.340414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:45.340414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:45.340414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 288/582] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:45.343217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.393542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.438651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bfe66-839a-4fdf-a280-0cd5f3255f0d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.454440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36cb19-f3fc-41ad-8b31-787bd88e3a6d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.473944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.474795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.475073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.475339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.484390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.485974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.492091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.492800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.493078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.493345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:45.499585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:45.500736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:45.501953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 295/583] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:45.503943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.505559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.506633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:45.520210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:45.521323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 289/584] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:45.522261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.559921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.618972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559f52-3dcb-4f41-9391-be27b4213c9b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.633266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682a475-cf8b-4c98-991e-fa1a6f3aac4b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.641372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.656799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.657518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.657860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.658197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.666478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.667941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.669602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.670309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.670702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.671093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.671829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.672230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.673683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:45.678887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:45.679956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:45.681130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:45.686626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 296/585] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:45.686626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.692564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 290/586] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.697099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.792472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ad0a1-150e-416a-b959-256bb225679c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.798366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.808262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4bc9-c33e-4441-8926-e0934d0b3b86 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.830276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.830993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.831373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.831739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.832564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.832976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.834484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.843823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:45.844552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:45.844927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:45.845303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:45.846092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:45.846499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:45.848053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:45.859503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 297/587] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.859503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.865831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 291/588] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:45.867684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:45.905162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:45.979725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac5e29-2eff-43ca-9973-b4c22cdb2b18 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:45.982906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95329-8cbf-4bd3-8f6f-8a30212ea3b1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.017153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.017782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.018058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.018327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.019238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.019950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.020358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.020730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.021570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:46.021978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.023677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.027139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.028590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.042093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 298/589] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:46.043072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:46.043786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:46.044875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:46.046049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:46.048070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 292/590] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:46.049182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.066144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.152440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.154715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f4fb-ff71-4758-8d4e-4eb6b9d82866 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.158972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b507d92-8021-45bf-a246-c3fa5064897c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.191575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.192242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.192526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.192785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.198173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.198835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.199118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.199390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.208297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=716bdc59d9eb46398492fdea1759ed7a, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.209755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.210123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.211495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:46.226837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:46.231593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:46.232981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:46.232981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.232981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:46.232981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 299/591] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:46.232981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.311069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 293/592] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:46 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:46.312110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.334916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d5b92-068c-4137-ae14-aaae82c9b38b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.376844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.377490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.377857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.378134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.390434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.391940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.402212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:46.409453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:46.410619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:46.412083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:46.412083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.412083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:46.412083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 300/593] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:46.412083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.412878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.462271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ab03-3086-4670-bfdd-1d1025dcd6af None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.504022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.504639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.504908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.505178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.506021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:46.506325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.508397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f09ff-d102-4a8c-9698-e8695b773fdb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.530855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 294/594] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:46.530855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052afc5a-1fec-42fd-9f21-ee355a63cf46 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.530855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052afc5a-1fec-42fd-9f21-ee355a63cf46 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.530855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052afc5a-1fec-42fd-9f21-ee355a63cf46 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.531684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 295/595] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:46.532390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052afc5a-1fec-42fd-9f21-ee355a63cf46 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.533976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262668-96ce-49b3-bdfd-4d85c1491b39 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.580214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.580834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.581116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.581388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.582469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:46.582804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.584573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.601629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 301/596] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:46.606894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.646044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052afc5a-1fec-42fd-9f21-ee355a63cf46 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.670353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.671147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.685867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.686482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.686778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.687053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.687698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:46.688000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.689369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182278a8-a879-4e62-8bca-4ca8f22d5db5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.701665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 296/597] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:46.704150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.705162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.706819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.714130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680013e9-9914-4480-bdcf-0cf5c69874a7 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.725578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:46.727679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:46.751338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.752001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.752258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.752528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.764057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.769432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:46.782238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:46.783430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:46.784560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:46.784560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:46.784560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:46.784560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 302/598] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:46.784560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.810092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 297/599] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:46.811148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:46.903535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add957d-472d-43fa-ab28-1d3c8754e75e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.919735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.921901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df138-474a-4c40-a79c-11d9964f4532 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:46.940141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:46.948550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.949785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.950165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.950742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.967329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:46.968080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:46.968364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:46.968640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:46.969061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.971140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.978656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:46.980573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:46.985749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:46.986875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:46.988027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:46.994753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 303/600] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:46.994753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:47.007772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:47.009043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:47.010164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:47.016948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 298/601] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:47.016948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.122392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3935a1-f441-4a82-b2e3-bfe8b4bea329 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.128223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba856591-d02d-49cd-a7f4-dc36ee772bc0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.158113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.158741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.159022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.159296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.159981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:47.160286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.161716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.163844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.164448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.164737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.165001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.165648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:47.165954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.167359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.175763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 299/602] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:47.176547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.194490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 304/603] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:47.194490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.220969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.231628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.302256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a436a5-e485-479b-b8e1-beadf7b07a3e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.317153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016268-9fc8-41ae-ae06-0fa52a3ddefd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.340237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.340890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.341171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.341441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.352851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:47.354565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.355208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.355488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.355759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.356455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:47.356760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:47.357761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:47.358675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:47.359799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:47.360489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.360568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 305/604] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:47.360568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.378846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 300/605] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:47.378846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.465592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.475114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4884-e39f-4227-80c2-4ea7ded28e7e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.481194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.490130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c647712-7ee4-4f10-9908-89aeef2621f0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.518392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.519302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.519582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.519857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/55c40c8bb3b24e07b3189f84acd4ca02/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.526765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.532505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.532771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.533037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.537999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=55c40c8bb3b24e07b3189f84acd4ca02, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.540012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.544996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.546555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:47.565514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:47.566615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:47.567789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 301/606] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:47.568371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.618397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 306/607] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:47 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/55c40c8bb3b24e07b3189f84acd4ca02/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:47.619248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.691844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923336-41d2-425b-b05a-9699070ec99a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.734394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.734982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.735259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.735525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.736198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:47.736496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.737893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.748101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 302/608] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:47.749019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.766983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.774818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292064b-c4a0-4235-baee-3184cb4a8c27 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.816469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.817375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.817802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.818217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/e162ed7a337a40f5875048254f16a2ce/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.836290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:47.840152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=e162ed7a337a40f5875048254f16a2ce, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.841600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.871373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b7b6-da53-4574-9ca2-fc4ce7ea16ba None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:47.917992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:47.918770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:47.919148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:47.919518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:47.920330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:47.920734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:47.922249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:47.937983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 303/609] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:47.937983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:47.948050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 307/610] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:47 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/e162ed7a337a40f5875048254f16a2ce/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:47.958301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.105832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:48.150995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60426-d470-4976-b5cc-87408fe32a6c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.166124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a4dec-76d0-4df3-8dd1-7bee16dacb73 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.201328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.201328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.201629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.201818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.215607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:48.217077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:48.232511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:48.233532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:48.234472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:48.234472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:48.234472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:48.234472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 304/611] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:48.235687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.236438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.236789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.237131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/9ae3b9603f0b45cebed05cdeb0d50be9/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.245866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.280865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=9ae3b9603f0b45cebed05cdeb0d50be9, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:48.285136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c03bf-7dc1-45d1-90fa-b6159b87c66c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:48.378049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 308/612] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:47 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/9ae3b9603f0b45cebed05cdeb0d50be9/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:48.385114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465d57-8d50-4ab0-a535-beb7a1eccfc2 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.385707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465d57-8d50-4ab0-a535-beb7a1eccfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.386244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465d57-8d50-4ab0-a535-beb7a1eccfc2 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.386437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef179a9-bb3c-484b-aa7a-0abbb61d5441 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.391582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 309/613] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:48.399316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.399940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.400427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.419867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:48.432685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.433420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.433752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.434122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.437363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:48.437363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:48.437363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:48.438895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:48.440367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:48.455410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 305/614] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:48.457844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.505666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:48.565450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 310/615] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:48.574631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccec0ab-82c5-42fb-bcf2-802e8a48df75 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.616974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.617635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.617913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.618187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.626636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:48.628185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:48.641444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:48.642442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:48.643463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:48.646945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 306/616] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:48.648815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.766584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50ed9a-64e6-4504-8efe-7ae13d6603b5 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.803912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.804833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.805260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.805717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.806599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:48.807081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:48.808687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:48.827506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 311/617] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:44:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:48.833421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.885746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:48.923129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:48.950028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9bab-156b-4eba-b39a-f0f16ce42f93 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:48.986875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:48.987838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:48.988266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:48.988762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:48.999847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.001539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:49.017188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:49.018409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:49.019699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:49.019699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:49.019699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:49.021510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 307/618] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:49.028081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.060628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.171188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.181282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df8b9-ac5d-435e-8ce7-d174fea132d0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.185847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6e57d-6371-4ab7-9272-d6d764257f27 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.243981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a693563-9acd-483c-834d-28b467348585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.245043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693563-9acd-483c-834d-28b467348585 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.245539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693563-9acd-483c-834d-28b467348585 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.246023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693563-9acd-483c-834d-28b467348585 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.258258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a693563-9acd-483c-834d-28b467348585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-4a693563-9acd-483c-834d-28b467348585 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:49.263895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:49.264897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:49.265835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:49.267396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.268022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.268301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.268575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.269231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:49.269596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.270027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 312/619] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:49.277889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.279200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a693563-9acd-483c-834d-28b467348585 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.299730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 308/620] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:49.306474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.450456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.468927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a693563-9acd-483c-834d-28b467348585 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.484278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e172f9-3016-43e7-86bc-ce83d57af8fe None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.535505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.536176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.536491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.536760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.537428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:49.537727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.539681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.550324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.550984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.551258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.551529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.561068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 313/621] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:49.561889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.563440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.567245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:49.584356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:49.586035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:49.587659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:49.588354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 309/622] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:49.592142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.631203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.723278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274669-3840-4703-b0db-18c4f65298b4 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.753110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9482e-8356-4add-8dd4-ca868a2eec4c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.761861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.762948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.763228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.763500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.764209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:49.764959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.766782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fecab-3e81-4f55-8d4c-8f7c18cfd6be None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.782560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 310/623] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:49.784104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b358-ac41-464a-94c0-0efc1f48300d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.784546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b358-ac41-464a-94c0-0efc1f48300d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.784821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b358-ac41-464a-94c0-0efc1f48300d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.786868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 311/624] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:49.787554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b358-ac41-464a-94c0-0efc1f48300d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.803187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.804334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.804990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.805290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.821033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.823294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-2b9161a7-e8fa-40c3-b4c6-b7f6f14be32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:49.846371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:49.847432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:49.848365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:49.848365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:49.848365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:49.848753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 314/625] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:49.849754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.853888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.853888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.859854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.871209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:49.872594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:49.881429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:49.910437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b358-ac41-464a-94c0-0efc1f48300d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:49.949803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:49.950530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:49.950845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:49.952222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/86f47c546d1b47d69252eaa11b5a3f24/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:49.975103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 315/626] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:49.976728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:49.978044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=86f47c546d1b47d69252eaa11b5a3f24, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:49.979580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.065951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 312/627] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:44:49 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/86f47c546d1b47d69252eaa11b5a3f24/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:44:50.110316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a43270-a51b-4478-8601-0b0a5036954d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.149520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.150146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.150426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.150763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.151474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:50.151787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.153224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748dff4-4ed4-4d0b-9402-299c06f98471 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.154922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.168058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 316/628] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:50.173972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.271844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bafb22-599b-4427-aed4-33e3c5181f2d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.272518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bafb22-599b-4427-aed4-33e3c5181f2d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.273011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bafb22-599b-4427-aed4-33e3c5181f2d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.275202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 317/629] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:50.280647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.281263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.281763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.312476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:50.313664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:50.325749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ac9db-32ac-4bd1-a746-41153912408d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.359560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.370907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.374546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.374546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.374546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.383556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.385611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.396299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 318/630] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:50.397204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:50.411979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:50.413615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:50.414610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:50.416232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 313/631] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:50.421908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.514026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ce41c-aad5-4d7b-9726-d7695c79bad6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.529595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605610-9233-4cc3-8aad-769f45e1c0c9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.541886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.555364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.557620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.557620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.557620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.568946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:50.573887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.574633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.575035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.575425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.576267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:50.576608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:50.578286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:50.579978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:50.581317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.581317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.585380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 319/632] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:50.592505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.610010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 314/633] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:50.615652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.664414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.714263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6035bf-f6ea-4aa4-b417-4d9f1ed40313 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.755346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.756329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.757344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.757829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.758752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:50.759309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.761424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.770842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 320/634] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:50.776601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:50.784113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a31e1-3ec3-4a8b-b592-92ff6e12b1f9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.831426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.832441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.832982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.833457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.847546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.916294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46428-060d-4d85-88f8-5b71c29a970f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:50.927544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.930454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cc20e-bc7e-4c03-ad54-e575d066c785 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:50.974032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:50.974671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:50.974982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:50.975251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:50.985013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:50.991891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:50.999746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:51.010193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.011422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:51.012356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:51.012356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.012356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.012356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 321/635] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.012356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.052953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 315/636] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:51.052953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65abd-2e77-43ff-a4e0-333ac06ba887 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.052953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65abd-2e77-43ff-a4e0-333ac06ba887 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.052953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65abd-2e77-43ff-a4e0-333ac06ba887 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.055101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 316/637] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:51.055847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65abd-2e77-43ff-a4e0-333ac06ba887 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.126540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.130370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645fb15-89f8-4772-948b-99aeb70e5804 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.167165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.167787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.168066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.168378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.170318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65abd-2e77-43ff-a4e0-333ac06ba887 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.179420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:51.184240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.185460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.186354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 322/638] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.187106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.213353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.213960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.214240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.214508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.215191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:51.215494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.216862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5b90-968c-405d-ad34-59fb661e0501 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.228967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 317/639] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:51.229994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.230279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.230593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.238315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.248912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:51.250159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:51.307967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528599d4-682d-4ae2-a92b-5fbaa76284ad None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.325173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 318/640] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:51.326023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.368388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.369060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.369360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.369668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.381240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.383509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:51.399618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.400638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:51.401530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:51.401530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.401530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.401530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 323/641] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.402183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.416613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.467178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777478b9-472e-4dbd-a12b-414f2a54cbaf None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.511339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.512316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.512790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.512895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994cfbf-85ea-4f3f-bd69-c48319dbc82d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.513352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.514214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:51.514882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.517255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.518871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.532486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 319/642] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:51.532486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.558897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.559792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.560071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.560340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.570365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.572097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:51.587158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.588190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:44:51.589150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.593123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 324/643] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.594141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.653918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a300-dd54-44b7-9e54-04d8e142c73a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.673962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.688524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.689128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.689404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.689670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.690320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:51.690590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.692008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.708538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 320/644] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:51.708538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.712280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e0bea-dbf6-49e1-a945-79190b92dc0b None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.748622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.749251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.749532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.750002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.762317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.763804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.767057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:51.779030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.780171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:51.781413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:51.781413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:51.781413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.784978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 325/645] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.785869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.814894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b967964-7a2f-4431-b586-54dbce783afb None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.849551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.850148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.850426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.850930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.851664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:51.851977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:51.853394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:51.875858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 321/646] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:51.875858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.897107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4be10e-54e8-445c-8fdd-6d0d3facd3ec None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:51.919614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:51.935358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:51.939126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:51.939126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:51.939126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:51.948312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:51.953104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:51.954039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 326/647] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:51.960489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:51.989182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da9ea-3f39-40ec-bc17-682ab3ced8a0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.004221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.030040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.030896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.031336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.031768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.040799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.042232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:52.053597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:52.055100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:52.056052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 322/648] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:52.056570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.070916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367da8f-01ec-4711-af35-680975a1fc54 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.105494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.106098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.106375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.106643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.107308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:52.107606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.108960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.125505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 327/649] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:52.125505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.163135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f61f-42ab-424f-b48e-157bb698ca3d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.172335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.199079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.199687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.199958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.200225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.234986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2aa20-f148-42f2-9c38-c6d50e60699d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.246164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.271439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.272042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.272318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.272570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.272713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.273306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:52.273652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.273998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.275023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.287924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 328/650] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:52.287924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.380162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 323/651] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:52.381025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.391134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36edd-3b37-4fed-995f-fc478ebc43ea None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.395282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.428025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.428819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.429142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.429406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.430132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:52.430641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.432251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.444046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 329/652] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:52.444894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.459112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.484570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b395-bbca-4eca-9514-cfcf453094f5 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.518868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.519505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.519784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.520053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.528257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.529697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-b022b0f5-ff6b-4678-82ee-e083851ba82f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:52.542339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:52.543374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:44:52.544339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:52.545213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f072e9-3b59-4b94-9d9a-4f829e92e8d1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.545298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 324/653] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:52.545298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c0a3-5c4c-4b96-86d7-175d5ee282a7 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.545298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c0a3-5c4c-4b96-86d7-175d5ee282a7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.545298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c0a3-5c4c-4b96-86d7-175d5ee282a7 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.550551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 325/654] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:52.550551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608c0a3-5c4c-4b96-86d7-175d5ee282a7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.581939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.582565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.582875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.583141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.593960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.595413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:52.609719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:52.610905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:52.612118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:52.612118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:52.612118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:52.612118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 330/655] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:52.612118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.629316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.666878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608c0a3-5c4c-4b96-86d7-175d5ee282a7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.708240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.708860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.709136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.709407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.712284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.723253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.724743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.727818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a74eb-8f3c-4b19-8e47-e26db99a4a5c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:52.739747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:52.740916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:52.742453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:52.742453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:52.742453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:52.742453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 326/656] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:52.742453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.763991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.764598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.764911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.765182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.765895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:52.766198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.767640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87840a1d-a9c8-4161-aacd-b3fc23592a35 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.773730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 331/657] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:52.774957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.775236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.775503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.795673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:52.798683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:52.855283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ed34-a80e-4976-bf51-08b5a262e6f7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:52.887078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 332/658] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:52.887994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.898166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:52.899249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:52.899658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:52.900066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:52.901020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:52.901497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:52.903312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:52.904154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:52.924609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 327/659] 10.222.0.58 () {56 vars in 1137 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:52.925667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:52.996723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.028752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608e7e-ca57-4310-be9c-7d5ecbaee703 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.065555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbcbb7-4e66-4444-89f5-aa7193f1fb37 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.073543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.074161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.074490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.074821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.076039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:53.076352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.078352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.096144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 333/660] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:53.099442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.111371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.112532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.112819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.113096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.113749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:53.114054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.115938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.135412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 328/661] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:53.138864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.181811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.214996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1bb5-a19c-48b8-8016-113e9c8a6fcb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.248767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.249511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.249861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.250190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.271105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ede8-892a-433f-8473-1835334b2013 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.273966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.308680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.309476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.310091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.310374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.318872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.321036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.322392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.323972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:53.332868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:53.334066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:44:53.335590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:53.338917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 329/662] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:53.339515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.397697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.437960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 334/663] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:53.437960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.452140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6bdb3-220c-49f7-9ecf-06ec4b33ed83 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.490709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.491926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.492202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.492467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.499540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.500994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:53.513596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:53.514542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:53.515857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:53.519423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 330/664] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:53.520275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.546302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b807-6879-48b3-90c8-4de02fd81a65 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.548453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.588351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.589055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.589262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.589529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.599974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:53.605426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:53.606403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:53.607306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 335/665] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:53.608050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.637920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20273c-9680-46aa-a9e6-1f990adcda5d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.639072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.674529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.675179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.675458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.675727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.676463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:53.676768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.678201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.697447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 331/666] 10.222.0.58 () {56 vars in 1139 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:53.698191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.719487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505757a3-e516-467f-8ac7-c28d5358b41f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.758885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.759683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.760056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.760419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.770986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.772555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.784022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:53.788799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:53.789924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:53.791061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:53.791061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:53.791061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:53.791262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 336/667] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:53.796588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.808742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e368191-bda3-4771-9e4d-7a5a40b46392 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.844951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.845548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.845820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.846084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.846789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:53.847188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.848514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.865941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 332/668] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:53.867228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:53.887535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:53.910881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6d874-6110-4ec2-bd7d-9f161463b095 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:53.952578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:53.953204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:53.953386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:53.953654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:53.954315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:53.954616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:53.956033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:53.968097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 337/669] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:53.968911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.007312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc00a-cd03-4a8c-9405-3cb573991f84 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.049025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.049635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.049914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.050189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.063399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.081416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd6ed8-0fcf-497f-8afb-bb1d6ce3e403 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.118396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.119048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.119332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.119600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.120241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:54.120542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.121898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.122848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.124304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.134234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 338/670] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:54.135135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.141703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.236933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 333/671] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:54.238168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.248820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d273c-c4dc-416b-8f0b-9a92f1b19332 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.284594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.287430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.288128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.288555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.288729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.289619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=55c40c8bb3b24e07b3189f84acd4ca02) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:54.289921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.291425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.307002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 339/672] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/role_assignments?user.id=55c40c8bb3b24e07b3189f84acd4ca02&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:54.307002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.367454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac54a0-5617-4e0d-8c90-5c37cb3f1f1e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.400467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.416726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.417753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.418116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.418460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.432880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.435064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.443109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a11d9-81d5-4198-ba64-2ee8222fa7f9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:54.456064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:54.457158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:54.463577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:54.463577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:54.463577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:54.463577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 334/673] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:54.463577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.487940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.488511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.488977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.490793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.501868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.503531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:54.527593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:54.528576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:54.529506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 340/674] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:54.530020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.589118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.598687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0898-8f03-4ee0-ae3a-16cda8388098 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.649346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.650383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.650781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.651563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.654582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06f0af-643b-4e45-97ff-43343ec34c55 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.665216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.669245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.687610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:54.692706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:54.693729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:54.695380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:54.695380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:54.695380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:54.695380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 335/675] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:54.695380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.704055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.704904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.705278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.705643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.706496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:54.706936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.708499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.723308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 341/676] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:54.730013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.825101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79719a1a-91c0-4dc1-b54e-135f9e371c79 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.856537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020168-0496-48f2-a962-8d62a0ffb69d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:54.874405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.875044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.875326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.875666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.876367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:54.876676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.878116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.891110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 336/677] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:54.891776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.900865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:54.901480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.901750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.902012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.902652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:54.902979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:54.904337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b09bd-7ec0-4194-aba9-e7ccea159764 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:54.904476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:54.916631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 342/678] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:54.917930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4af13-4518-4acf-a0e0-8b7dc30a652e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:54.918214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4af13-4518-4acf-a0e0-8b7dc30a652e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:54.918485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4af13-4518-4acf-a0e0-8b7dc30a652e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:54.923659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 343/679] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:54.923659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4af13-4518-4acf-a0e0-8b7dc30a652e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:54.979305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.020761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd662bf4-3f0e-4403-975a-d7022434f225 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.040984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4af13-4518-4acf-a0e0-8b7dc30a652e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.061344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.062122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.062501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.062918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.071280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.072861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.084415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.085822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.086329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:55.086649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:55.087784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:44:55.088925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:55.089724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.090590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=e162ed7a337a40f5875048254f16a2ce) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:55.091047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.092663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2693fc2-17d3-480a-ba79-2dcdf34b6d12 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.095374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 337/680] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:55.096317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.107643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 344/681] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:54 2022] GET /identity/v3/role_assignments?user.id=e162ed7a337a40f5875048254f16a2ce&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:55.112590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.112590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.112590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.140481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:55.145018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:55.239748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.296306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b84b-f2f5-47cb-a2e0-4395a946b54e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.297331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 345/682] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:55.298201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.346143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.347189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.347672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.348137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.356181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.358523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:55.372254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:55.373206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:55.374125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:55.382515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 338/683] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:55.383677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.384193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.490977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0b5a8-6d26-4d65-9158-ae15dadfc68e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.531658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.532330 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.532613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.532890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.533622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:55.533922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.535789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.554178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f255d5-4aed-4ab0-bfee-6d6bac0c7c21 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.564576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 346/684] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:55.566132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.616320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.626705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.633857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.644516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 339/685] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:55.651449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.681168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.685011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df96e8-c0e9-4c47-9d56-d2366be845a9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.719344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.720024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.720206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.720474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.761739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699eebe-8360-4a3a-98ed-dfce649bf2b2 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:55.792364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.793759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.799430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:55.800280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:55.800760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:55.801288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:55.802208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=9ae3b9603f0b45cebed05cdeb0d50be9) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:55.802716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:55.804434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:55.818896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 340/686] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/role_assignments?user.id=9ae3b9603f0b45cebed05cdeb0d50be9&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:55.820959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.900689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:55.909690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 347/687] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:55.925086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:55.925239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.018810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb6d37-3d24-45b5-8aa7-c31863946b08 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.019427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc1aa-fe83-412d-ad7b-8df1458fee76 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.056428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.057382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.057382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.057838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.069976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.071942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.085894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.087147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.087602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.088018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:56.094792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:56.095869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:56.096910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:56.096910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:56.096910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:56.096910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 348/688] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:56.098141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.112323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:44:56.128361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:56.129576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:44:56.130606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:56.133641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 341/689] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:56.139170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.160889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.209968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfeb9c-6918-43d4-a64e-2488a9e45822 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.245295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923240-654b-404c-8222-3cd45581df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.246250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923240-654b-404c-8222-3cd45581df2e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.246423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923240-654b-404c-8222-3cd45581df2e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.246822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923240-654b-404c-8222-3cd45581df2e None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.247585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923240-654b-404c-8222-3cd45581df2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:56.247985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923240-654b-404c-8222-3cd45581df2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.249448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923240-654b-404c-8222-3cd45581df2e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.266717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 349/690] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:56.268016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1da63-9792-4e9b-a2d4-3ae226f80b5a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.268354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923240-654b-404c-8222-3cd45581df2e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.296555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.307623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.308480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.308894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.309298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.310419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:56.310884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.312646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.326150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 342/691] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:56.331604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.390319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923240-654b-404c-8222-3cd45581df2e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.416092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.450248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.455194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.455476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.455766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.467669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.469414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:56.490444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:56.492249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:56.493493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:56.498488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 350/692] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:56.500988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.510916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90129e-6b8b-4b86-80bf-5bccc1e96178 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.567164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.567796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.568071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.568899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.583664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.586002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-bc79b549-315a-4760-aa8f-cbf805651bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:56.608478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:56.609690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:56.610766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:56.610766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:56.610766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:56.610766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 343/693] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:56.614826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c08-5af9-4ca4-ba0a-bdbca0248124 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.614826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c08-5af9-4ca4-ba0a-bdbca0248124 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.614826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c08-5af9-4ca4-ba0a-bdbca0248124 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.614826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 344/694] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:56.620832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7c08-5af9-4ca4-ba0a-bdbca0248124 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.650252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.651522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547380e1-c815-4902-8945-ab5b66299a37 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.692621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.695686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.696132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.696557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.698718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:56.699312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.701964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f57e0-4e40-4966-9721-8002f04c861f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.719629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 351/695] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:56.721399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.721814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.722285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.745416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:56.747512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:56.754918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7c08-5af9-4ca4-ba0a-bdbca0248124 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:56.784934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:56.801459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:56.802201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:56.802582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:56.802994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:56.803855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:56.804618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:56.806516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:56.826308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 345/696] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:56.826308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.847282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 352/697] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:56.848302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:56.976979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:57.008160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8612d-02b7-481e-8be7-cc1de11b42e1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.037945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e04a-595d-4d4d-89dc-0a9260074724 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.073500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.075080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.076169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.076663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.077741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=86f47c546d1b47d69252eaa11b5a3f24) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:57.079083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.080945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.090568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 346/698] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/role_assignments?user.id=86f47c546d1b47d69252eaa11b5a3f24&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:57.103474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.104511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.104993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.105489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.117777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.119681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:44:57.144273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:57.145315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:44:57.146290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:57.149889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 353/699] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:44:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:57.155699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.280186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.300661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d52f3-b987-4be8-9a63-382990829866 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.319084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:57.343520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.344281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.344666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.345034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.345771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:57.346075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.347554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.370816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 347/700] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:44:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:57.377959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.390246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:57.440984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024a979-276e-4e14-ae4d-07b4ff3efe35 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.492573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.492573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.492880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.493035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.503921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.505370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e60b40e3-b956-42cb-aac6-c6465f31ac7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:57.521519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:57.522714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 354/701] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e84dd9-5b42-497c-9950-4b7e424cf374 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e84dd9-5b42-497c-9950-4b7e424cf374 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.524502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e84dd9-5b42-497c-9950-4b7e424cf374 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.527898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 355/702] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:57.529684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e84dd9-5b42-497c-9950-4b7e424cf374 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.531949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d15ece-8447-4fde-80c1-ff3d02b7209f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.579983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.580604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.580883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.581420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.619665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:57.655008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e84dd9-5b42-497c-9950-4b7e424cf374 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:57.691275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.692739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.701475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:57.707067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:57.708458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.709307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.710716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.711618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:57.712339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:57.714297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72fc7e-06ba-4c84-8d7f-e00245f24422 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:57.733220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 356/703] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:57.734827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:57.735469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:57.735947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:57.761507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:57.763808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:57.819452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 348/704] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:57.821025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.854750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 357/705] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:57.854750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:57.982281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.032768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b758e-d12a-41b9-8546-a9dbafaba768 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.044860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.061843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049eeed-cbec-4006-bc9c-ee58683fd31f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.085723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.086660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.087110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.087534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.088332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.090851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.123435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.124299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.124756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.125177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.137565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.139232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:44:58.155645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:58.157596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:44:58.158765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:44:58.158765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:44:58.158765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:58.159887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 358/706] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:58.165467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.191208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 349/707] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:44:57 2022] POST /identity/v3/users => generated 254 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:44:58.198754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.307815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a228-8308-4d5a-b1cd-43051ca0a0cf None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.331869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.352467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.353025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.353309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.353582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.354245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:58.354548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.356010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333184e6-b54d-44d3-953b-2c4ce70497c6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.371549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 359/708] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:58.371982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dad9a-3080-4155-b433-58b51ce75d5d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.374761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01e85-7ad4-4350-94c8-65774f83abf5 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.374883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dad9a-3080-4155-b433-58b51ce75d5d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.374883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dad9a-3080-4155-b433-58b51ce75d5d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.378602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 360/709] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:44:58.378966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dad9a-3080-4155-b433-58b51ce75d5d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.415125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.415763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.416053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.416358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.416959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.418329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8cad7e54-efdd-45d0-ad1e-5e05dc157aa0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:58.431548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:58.432632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:44:58.433509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 350/710] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:58.434312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.434312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.436539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.455761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:58.456986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:58.481396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.519627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dad9a-3080-4155-b433-58b51ce75d5d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.550755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 351/711] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:58.550755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.588728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.589415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.589690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.589955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.602200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.604427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:44:58.629905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:58.630898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:58.632931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 361/712] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:58.637060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.704559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.721826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c719b4-c2b0-4772-ab6d-b98e643945c5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.784021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.785030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.785520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.786100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.786980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:58.787492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.789312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.794986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 352/713] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:58.800582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.822942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c482a-14a4-4042-b7be-2397b6faf886 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:58.842067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:58.886360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:58.887961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:58.888508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:58.889797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:58.890713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:58.891251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:58.892891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:58.907412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 362/714] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:58.908653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:58.968872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3c915-4506-4440-853d-77f73d7c9523 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:59.011809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:59.014536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:59.015432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.015716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.016036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.017017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:59.017444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:59.019019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:59.019994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a4a1b-8044-403c-ae79-f3a2ef67a54d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:59.027224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 353/715] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:44:59.028144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:59.083004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:59.084312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.085990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.086482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.087398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:59.090287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:44:59.114261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:44:59.115385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:44:59.116984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:44:59.125021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 363/716] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:44:58 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:44:59.131438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:59.205096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:59.224681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cb42b-e7e2-4b12-9b93-dbc0cfdc24c1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:59.264636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:59.265251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.265531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.265805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.266536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:59.266877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:59.268392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:59.278936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 354/717] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:44:59 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:59.321833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9d32f-d8f3-4a96-acc4-60e583cd3bc2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:59.384137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:59.384740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.385018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.385289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.385939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:59.386237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:59.387657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2f3c6-da10-4043-a734-97e6d17fdfe2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:59.396211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 364/718] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:44:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:59.402914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:44:59.485675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff57b-4271-40f3-b3e5-c8bd744cc754 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.485972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff57b-4271-40f3-b3e5-c8bd744cc754 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.486145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff57b-4271-40f3-b3e5-c8bd744cc754 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.487859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 365/719] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:44:59.493619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.493897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.494170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.514771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:44:59.516005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:44:59.540431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:59.582589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd08c3-7e61-406c-8c0d-b5a86f9ac509 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:44:59.629659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 366/720] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:44:59.650720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:44:59.651354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:44:59.651627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:44:59.651896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:44:59.652530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] RBAC: Adding query filter params (type=network) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:44:59.652828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:44:59.654306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:44:59.659779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 355/721] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:44:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:44:59.931303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:00.065241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4a418-4758-40ac-b200-f44c877f9a22 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:00.116051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:00.117129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.117649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.118125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.137558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:00.142784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:00.143733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:00.144578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:00.148920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 367/722] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:00.154324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:00.175168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:00.288984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073454-7e7c-4fca-8023-e2a0c02745eb None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:00.332695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:00.333302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.333576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.333847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.334509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:00.335498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:00.336876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb7b3e-f4eb-4554-a9c1-965f4e752a49 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:00.348781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 356/723] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:00.354990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:00.380967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:00.493551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38871-4dd6-41ee-8674-1da4ad3bd7d7 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:00.527934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d948b-60f3-4c57-a95b-89402958f05f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.528281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d948b-60f3-4c57-a95b-89402958f05f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.528482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d948b-60f3-4c57-a95b-89402958f05f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.529966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 357/724] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:00.534830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.535113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.535385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.547749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:00.548316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.548597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.548863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.555611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:00.557092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:00.570582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:00.572070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:00.598205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:00.599379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:00.601559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:00.601559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:00.601559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:00.601559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 368/725] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:00.606520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:00.674973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:00.712029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 358/726] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:45:00.718764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5283353-524f-4abd-a5a7-5143d1582517 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:00.796818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:00.797435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:00.797716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:00.798036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:00.798632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:00.798966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:00.802312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:00.821398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 369/727] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:00.826482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:00.833845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:00.974445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eed55-efcf-49cc-a990-86022930ec66 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.030606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.031274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.031553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.031825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.035087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.044578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.046058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:01.063437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:01.064442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:01.065406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:01.067616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 359/728] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:01.079945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.149646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934d28-bd8d-4d31-aa45-d97bf3be48eb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.180318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.190076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.190707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.191013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.191354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.201938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:01.207050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:01.207996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:01.208867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 370/729] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:01.214866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.217516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.264518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6a39-5881-4a7a-80e0-5254febeea4a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.324495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.325232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.325471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.325827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.326575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:01.326907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.328546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.331484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa16d-af6d-4ef5-95d7-66d4b4ceabaf None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.365210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 360/730] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:01.372134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.375912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.376529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.376806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.377074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.377741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:01.378045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.379659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.404997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 371/731] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:01.410522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.490787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a1e39-8167-4c94-a5a6-65ee3286a7a6 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.513168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.527725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.540674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.541471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.541923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.542436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.572113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9f7c-0789-40dc-a653-4abc00855c77 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.609969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.610522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.610847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.611121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.622617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.624095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.634752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.636443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abff5-672e-4af1-818e-454093b57a1a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-c8fbcb4c-e79b-48f7-964c-fa02813d73c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:01.639206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:01.640293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:01.641417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:01.641417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:01.641417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:01.645076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 372/732] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:01.646383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589d1d-c773-493e-81bd-e5d8d449f036 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.646666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589d1d-c773-493e-81bd-e5d8d449f036 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.646962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589d1d-c773-493e-81bd-e5d8d449f036 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.648941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 373/733] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:01.649750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58589d1d-c773-493e-81bd-e5d8d449f036 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.769020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 361/734] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:45:01.770652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f32e00-48bb-4f4b-a012-5fcbf07885ae None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.770969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f32e00-48bb-4f4b-a012-5fcbf07885ae None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.771246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f32e00-48bb-4f4b-a012-5fcbf07885ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.788913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.793204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58589d1d-c773-493e-81bd-e5d8d449f036 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.797571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-56f32e00-48bb-4f4b-a012-5fcbf07885ae None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:01.799103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-56f32e00-48bb-4f4b-a012-5fcbf07885ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:01.822356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:01.834099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:01.835627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.836158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.836481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.837265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:01.837643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:01.839201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:01.852440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 374/735] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:01.853605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.883630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 362/736] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:45:01.884918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f33c3-4605-418d-a623-11492b848045 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:01.885274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f33c3-4605-418d-a623-11492b848045 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:01.885621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f33c3-4605-418d-a623-11492b848045 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:01.887150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 363/737] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:01.887729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f33c3-4605-418d-a623-11492b848045 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:01.977639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae36658-44c1-45b7-9064-e1bc1201cabb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:01.996740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f33c3-4605-418d-a623-11492b848045 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.015700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.016753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.017214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.017663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.030527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.032421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.034534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.035269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.035761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.035869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.044082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.045627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-61f26807-115f-4873-9766-0510535aeb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:02.049827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:02.051133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:02.052070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:02.052070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:02.052070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:02.054303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 375/738] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:02.055805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.056288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.056782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:02.058768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:02.059993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:02.061077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 364/739] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:02.061680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.078954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.083254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:02.084790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:02.101729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.166979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 376/740] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:45:02.168073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.181159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378daeb3-733f-4b7f-919a-c0cfe58f4e41 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.218140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.218778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.219061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.219334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.219978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:02.220281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.221655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.237340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 365/741] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:02.237340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.285991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a52ad-8a06-46c8-8081-1758e4f4272f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.310284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.322203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.322837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.323120 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.323426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.324124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:02.324427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.330318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378a0d-a57f-46f0-8e34-2583bacb4585 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.340262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.348034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 377/742] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:02.348181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfabe72-4e56-450e-9b71-a2a4278ae22d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.348603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8200-789d-46aa-a290-1a811d2b0e61 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.348603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8200-789d-46aa-a290-1a811d2b0e61 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.348603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8200-789d-46aa-a290-1a811d2b0e61 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.348603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 378/743] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:02.348603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8200-789d-46aa-a290-1a811d2b0e61 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.386285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.387212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.387478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.387745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.388396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.389760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.504005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 366/744] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:02 2022] POST /identity/v3/services => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:02.504843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.599970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8200-789d-46aa-a290-1a811d2b0e61 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.627069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e163af-ab7a-42ec-a9ab-0ad906db6d88 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.639228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.639982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.640255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.640522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.648318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.649776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-fe0b0f99-59be-47e9-a35a-92cb468b0e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:02.662209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:02.663991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:02.664929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 379/745] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:02.665417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.665599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.665883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.666155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.673874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.679214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.679214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.679214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.687276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:02.688489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:02.742906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.753250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:02.754874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:02.767360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 380/746] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:45:02.767360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.888738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68029de-7283-430c-8111-2bf198f8cb39 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:02.895089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 367/747] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:45:02.895986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.924702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:02.925569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:02.926022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:02.926434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:02.929973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:02.938638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:02.943888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:02.945471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:02.946334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:02.947258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 381/748] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:02.948364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:02.997076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.004982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c943-a122-4814-a631-0639bf0b76e6 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.043025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.043863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.044335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.044785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.046229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:03.046493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.048174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.056487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ab97-196f-4c5d-aa9c-dd7720678db0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.066166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 368/749] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:03.066166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.099483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.100279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.100846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.101361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.112921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.114515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:03.130649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:03.132646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:03.133836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:03.133836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:03.133836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:03.137206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 382/750] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:03.137851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.182274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.192932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292f3f-02b4-418c-9565-c75c4ee0d59b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.230935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.231539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.231813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.232079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.232861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:03.233162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.234520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.248626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 369/751] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:03.250044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.253345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.257319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ef6c1-963d-4e9b-879f-62ac1ff8a210 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.293074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.293675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.293952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.294220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.294959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=86f47c546d1b47d69252eaa11b5a3f24) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:03.295273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.296685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.301997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 383/752] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/role_assignments?user.id=86f47c546d1b47d69252eaa11b5a3f24&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:03.302787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.389953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7eed3-7070-40a3-84eb-592338eb1450 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.423498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31673c5-f0b5-497a-85c1-ed456bc0c733 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.432529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.433570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.434053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.434926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.435805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.437545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.460996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.461602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.462245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.462245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.462794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:03.463099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.464448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.476855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 384/753] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:03.477318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.505740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.534895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 370/754] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:03 2022] POST /identity/v3/services => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:03.536671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.563959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.657157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77230a-463b-44f9-892d-2ac3e16fff08 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.728408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.729539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.731165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.731637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.737757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b83cfb-230f-4032-a2d8-2bc5f07d61d3 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.745813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.747551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:03.765021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:03.766437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:03.767371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:03.767371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:03.767371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:03.769234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 385/755] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:03.775123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.782742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.783381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.783823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.784103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.794111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.795799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:03.813058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:03.814026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:03.815013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 371/756] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:03.832516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:03.860248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.905059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321f15-13c1-4129-8e95-28056f270266 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.923923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:03.954113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:03.954757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:03.955024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:03.955347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:03.955999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:03.956326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:03.957660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:03.977066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9100-a3a2-43af-b24f-149af445208b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:03.984613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 386/757] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:03.992383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:04.062768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.063846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.064339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.064816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.065701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:04.066195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.067914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:04.088509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 372/758] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:04.094786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:04.144989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a4dd8-4d59-40ae-b766-c6a2a52c24b4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:04.205316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:04.216969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.217607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.217887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.222616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.229850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.231323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:04.252071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:04.253161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:04.254113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 387/759] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:45:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:04.263011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:04.311254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dfe43-123b-4611-861d-96d933beb992 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:04.388302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.388940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.389225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.389491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.390229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=4461438f42034a62ae0b8923867c868c) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:04.390795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.392080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:04.394112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:04.404022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78febe97-8444-4849-8d4c-f5db4be789bb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:04.407459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 373/760] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:04 2022] GET /identity/v3/role_assignments?user.id=4461438f42034a62ae0b8923867c868c&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:04.449341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.449967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.450242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.450509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.451276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:04.451574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.453021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f182e-6442-4ac0-83f9-e49d59d3c45d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:04.473930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 388/761] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:04.479290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:04.635380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c7823-e4bc-42fa-acaf-771557f174d8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:04.636272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a3df-7227-4304-b858-4a55f53c524e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.636562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a3df-7227-4304-b858-4a55f53c524e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.636837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a3df-7227-4304-b858-4a55f53c524e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.638523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 389/762] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:04.644213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.644495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.644769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.680272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:04.681486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:04.701576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.702221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.702497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.702788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.724263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.726609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:04.746964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:04.747992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:04.749403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:04.749403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:04.749403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:04.749403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 374/763] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:04.755748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:04.766170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:04.812490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 390/764] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:04.855765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:04.918519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9f5b-8060-480d-a3b8-337382fd6684 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:04.956097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:04.956773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:04.957054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:04.957323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:04.957976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:04.958276 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:04.960719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.091289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 375/765] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:05.096880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.128022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.231636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cab02-69a8-4b04-a2d5-c8829374694f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.243303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:05.255845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605382e2-f240-4657-ab10-47da69ff9422 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.267867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.268505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.268783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.269055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.269645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.271046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:05.284194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:05.286121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:05.287934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 376/766] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:05.294760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.334260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.335498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.335982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.336449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.352527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.354391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:05.374011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:05.374986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:05.375885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:05.378463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 391/767] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:05.384466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.397398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc006f3-1f63-4b61-bce6-b277c9b9538a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.432857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.433483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.433762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.434030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.434962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:05.435267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.436650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.441741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 377/768] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:05.447823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.483650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:05.490794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:05.553149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee81434-a2c6-4966-a225-44cf8e6742fa None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.593889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.594510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.594819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.595096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.595736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:05.596041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.597428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4fe54-616c-488d-b178-84771809c392 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.603432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 378/769] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:05.606104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd959fe-a5e3-4847-8d77-6e37e5990b23 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.606383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd959fe-a5e3-4847-8d77-6e37e5990b23 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.606649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd959fe-a5e3-4847-8d77-6e37e5990b23 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.608245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 379/770] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:05.608984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd959fe-a5e3-4847-8d77-6e37e5990b23 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.631209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfda49-9f2d-4630-80b0-e2b5bda99f7f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.667577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.668187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.668466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.668736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.669429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:05.669732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.671306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208746e-82ae-4201-9409-c9c21c595244 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.684363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 392/771] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:05.686048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.686338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.686614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.708819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:05.710655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:05.744603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd959fe-a5e3-4847-8d77-6e37e5990b23 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:05.746750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:05.789392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 393/772] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:05.790110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.801381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:05.802049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:05.804113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:05.804113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:05.804113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] RBAC: Adding query filter params (interface=public, service_id=1d9e6f8bd2034307bbe3da5ae9c25170, region_id=RegionOne) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:05.804641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:05.805973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:05.814627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 380/773] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/endpoints?service_id=1d9e6f8bd2034307bbe3da5ae9c25170&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:05.819644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:05.880788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:05.984747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec513014-5ec8-4c32-8c9e-9e72375ebb38 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.027232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.028112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.028551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.028927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00586c1-3e43-42fc-9d57-d4b3896bcb6b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.029107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.031374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=716bdc59d9eb46398492fdea1759ed7a, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:06.032940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:06.072589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.073198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.073518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.073787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.074386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:06.075772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cb6fc-1526-43bc-910c-d9cfa592de1c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:06.081068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 381/774] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:05 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:06.082214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2afc1-7d42-48e0-b9bb-d03eeb2aa176 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.082845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2afc1-7d42-48e0-b9bb-d03eeb2aa176 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.082845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2afc1-7d42-48e0-b9bb-d03eeb2aa176 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.084218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 382/775] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:06.092663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.095131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.097120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.101426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 394/776] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:05 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:45:06.121622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:06.123115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:06.155117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:06.162068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:06.277413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 383/777] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:06.311592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:06.321502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32afbb-3f4c-43f4-9ee6-8ed6f3aeb354 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.356273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.356906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.357181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.357446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.370130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:06.375004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:06.375955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:06.376845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 395/778] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:06.382397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:06.527368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e3c36-97d3-401a-98cc-62235381fb8e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.571436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.572132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.572409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.572677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.573506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:06.573814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:06.575217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:06.584088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 384/779] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:06.591333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:06.611977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:06.648197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:06.774764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd314-1819-4f99-8d5d-47a8899afca3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.795313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182ebc-7e42-488f-8b98-c060b72d81e0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:06.841692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.842238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.842513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.842794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.859963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:06.861406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:06.864249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:06.864883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.865155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.865420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] PATH_INFO: `/v3/services/network` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.866714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:06.868168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:06.877880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-eeef7316-9f9d-4b1d-8f5b-5443c5231f6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:06.885507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:06.886707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:06.887851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 385/780] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:06 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:06.894814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e44-c7db-46f5-a533-ebb50219ccc3 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.895687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e44-c7db-46f5-a533-ebb50219ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-05221b95-dd36-4384-8714-8c023a84a245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:06.895796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:06.896913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:06.898087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:06.898087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:06.898087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:06.898312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e44-c7db-46f5-a533-ebb50219ccc3 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.899014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 386/781] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:06.899857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 396/782] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:06.902701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7e44-c7db-46f5-a533-ebb50219ccc3 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:06.904154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:06.904602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:06.905004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:06.926366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:06.928993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:07.022171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 397/783] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:07.023312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.023919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.048955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7e44-c7db-46f5-a533-ebb50219ccc3 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.118423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.119077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.119418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.119758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.120478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] RBAC: Adding query filter params (name=network) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.120899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.122398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.134882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 387/784] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.141489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.143716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5fe37-fd51-4ce4-83d0-36e2391a4d0a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.177446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.185989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.189765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.189765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.189765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.189765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.189765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.191111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.205679 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 398/785] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.218333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.329442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a25a5-d299-4017-9df0-495a7b014949 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.371199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.372355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.372809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.373250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.374053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] RBAC: Adding query filter params (type=network) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.374528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.376658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.383495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 388/786] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:07.389144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.405792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.422962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77756f-2ab8-4ce6-9bca-2d4c88a6c20c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.460690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.461337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.461616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.461887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.470623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.472230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:07.484769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:07.485741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:07.486704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 399/787] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:07.487331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.502333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09ad0c-41b1-49cb-ae8c-aae5d4bf2916 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.540815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.542179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.542680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.542981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.543779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.555056 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:07.560679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:07.561608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:07.562474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:07.564937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 389/788] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:07.565992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.600877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503bf7-ceb5-468e-ad02-935106a807ed None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.635038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.635603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.635845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.636110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.636804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] RBAC: Adding query filter params (interface=public, service_id=3920eb46e08548c1a450e760e7c1ffa4, region_id=RegionOne) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.637108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.638464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.650798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 400/789] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/endpoints?service_id=3920eb46e08548c1a450e760e7c1ffa4&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.650798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.654718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.683222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c784a0-ba65-49cd-bb2c-c3e3bab05b8e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.721768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.722700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.723304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.723820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.724801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.725961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.727685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.747558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 390/790] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.748971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.752487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47f7b-becf-4acb-bfda-033ef15c6783 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.767341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.789178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.789790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.790073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.790342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.791074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:07.791376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.792729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.801372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 401/791] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.801991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.896796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3299-1006-40d6-92a3-056c1abea2da None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.927864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ce7c-43ca-4007-9dae-b0fb87b7e363 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:07.935264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:07.944715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.953330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.953330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.953330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.953330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.953330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:07.961812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 391/792] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:07.963459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:07.973538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:07.974637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:07.975775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:07.976253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:07.992944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:07.994907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:08.017565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:08.018637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:08.019582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:08.019582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:08.019582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:08.022796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 402/793] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:08.026411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.061201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.120209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669488fb-7f88-4c38-b090-9240bb6e3a00 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.190674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.191431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.192031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.192307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.198823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329575-cf23-41f9-ae2a-1298727b41e9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.206833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.208294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:08.230546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:08.231773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:08.232951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:08.232951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:08.232951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:08.232951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 392/794] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:08.238864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.244860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.245498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.245783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.246059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.246820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:08.247131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.248602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.265354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 403/795] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:08.271726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.301014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.356301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef698cb-dea2-4b67-92a6-36f15e36cad5 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.369730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.383183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1f24-2ebb-438f-aa13-b43e80de8bd8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.399551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.400283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.400567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.400839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.401496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:08.401799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.403752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4005c-9177-44c3-a4eb-957e0f1e3bd2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.423385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 393/796] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:08.423385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cb93-d406-4482-b980-91789bfe318c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.423385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cb93-d406-4482-b980-91789bfe318c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.423385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112cb93-d406-4482-b980-91789bfe318c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.426596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 394/797] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:08.427291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.427773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112cb93-d406-4482-b980-91789bfe318c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.429451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.429952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.430415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.438433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.440144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7d2ebdfb-1075-41c0-97b5-aae468272bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:08.454783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:08.455883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:08.457004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:08.460797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 404/798] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:08.462122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c064b-0a93-449d-8022-a4c91186d659 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.462387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c064b-0a93-449d-8022-a4c91186d659 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.462653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c064b-0a93-449d-8022-a4c91186d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.481100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c23c064b-0a93-449d-8022-a4c91186d659 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:08.482493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c23c064b-0a93-449d-8022-a4c91186d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:08.541456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112cb93-d406-4482-b980-91789bfe318c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.552848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.563546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 405/799] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:08.565110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0595-c410-4e20-9d95-d349fe57b3f4 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.565560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0595-c410-4e20-9d95-d349fe57b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.568490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0595-c410-4e20-9d95-d349fe57b3f4 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.568490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 406/800] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:08.568490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0595-c410-4e20-9d95-d349fe57b3f4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.587103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.588243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.588614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.588959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.599136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.602508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d798e0bb-2f94-407a-ad25-138c91b48a1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:08.622839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:08.623889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:08.624861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:08.627072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 395/801] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:08.628449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.628877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.629297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.648740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:08.650256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:08.668782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.700883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0595-c410-4e20-9d95-d349fe57b3f4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.739155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 396/802] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:08.739994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.750289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.751259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.751705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.752136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.753031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:08.753878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.755349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.770666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 407/803] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:08.776367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:08.928823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55736ef-fcb5-4d00-afa7-71a30de3dc12 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.944221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:08.948793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59356eb0-9cff-4384-a488-0817692a8bb1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:08.967727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.968393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.968732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.969204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/86f47c546d1b47d69252eaa11b5a3f24/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.971137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=86f47c546d1b47d69252eaa11b5a3f24, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.972737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:08.991586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:08.992006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:08.992282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:08.992547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:08.993307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:08.993608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:08.995057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.012575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 397/804] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:09.017600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.041573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.046893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 408/805] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:08 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/86f47c546d1b47d69252eaa11b5a3f24/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:45:09.047683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.156519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab34e-cb23-4b37-bc9a-6c5ea63df4f0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.196524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5d308-8cd3-41c5-895a-4655351b6a42 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.199324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.200291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.200815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.201286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.202137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.203877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:09.217376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:09.218490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:09.219405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 398/806] 10.222.0.58 () {56 vars in 1129 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:09.220220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.248664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.269161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.269808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.270254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.270536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.290408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.292139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:09.314401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:09.315637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:09.316753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:09.316753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:09.316753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:09.318840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 409/807] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:09.320018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.342225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a4c13-cb27-49c3-9b11-646f64bea79f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.382005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.382879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.383159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.383431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.389016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.394592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:09.399639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:09.404642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 399/808] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:09.405507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.459184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1b71c-e099-4577-864a-12141ac10ddc None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.501583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.503647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.504262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.504538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.504807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.505432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:09.505732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.507390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.514977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 410/809] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:09.516110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.532944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2c255-7510-4ee8-80e9-956feb01df59 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.583411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.584077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.584305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.585085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.586431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:09.586756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.588138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.605415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 400/810] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:09.606516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.648496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec001-d6c4-4393-8396-12be243f5064 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.663948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.685654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.686680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.687229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.687695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.688549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:09.689059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.690682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.701956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 411/811] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:09.703190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.751582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74dc5-b2ef-4c4a-9650-030734337c7e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.790101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.791122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.791600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.792066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.792909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:09.793402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.795064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.800479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 401/812] 10.222.0.58 () {56 vars in 1124 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:09.801733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.806763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.830434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87418f9b-4069-4b1d-93b3-c22066df79e0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.880061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.880698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.880991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.881257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.889194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.891030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:09.906678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:09.907844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:09.908970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:09.915680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 412/813] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:09.916684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:09.923767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e869e-7590-41c3-baf2-142a21e920f4 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:09.968815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:09.970971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:09.971773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:09.972196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:09.972609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:09.988414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:09.990715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:10.010620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:10.011843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:10.012963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:10.012963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:10.012963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:10.018770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 402/814] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:10.018770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.060034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80221c-656a-441e-97d6-8654db689fc4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.080973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:10.108166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.109192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.109477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.110140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.110979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.112476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.132089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dd087-7116-438d-bfb5-a32aaff06db8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.169781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.170383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.170657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.170948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.171633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:10.171927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.173459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.187004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 403/815] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:10.191634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.232207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 413/816] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:10.233112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.315649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fde0f-3b08-4bc6-8e05-c239a025e888 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.336294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:10.362752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.363121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.363402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.363674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.364335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:10.364639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.366137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c593-b1b0-4785-b93c-8377ac1b7671 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.369435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:10.385644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 404/817] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:10.385644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e18340-d574-4f0b-a264-4c294668ce04 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.385644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e18340-d574-4f0b-a264-4c294668ce04 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.385644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e18340-d574-4f0b-a264-4c294668ce04 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.388393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 405/818] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:10.388656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1c7e-db84-46a9-9ec8-cf7feced372f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.389356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e18340-d574-4f0b-a264-4c294668ce04 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.438128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.439555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.439555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.439555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/4461438f42034a62ae0b8923867c868c/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.460450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=4461438f42034a62ae0b8923867c868c, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.462501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec155-b983-4564-a704-e2edecd62ebf None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.514565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e18340-d574-4f0b-a264-4c294668ce04 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.549656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.550225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.550435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 414/819] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:10 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/4461438f42034a62ae0b8923867c868c/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:45:10.550538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.550799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.552556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.553964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.555400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.577394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.577394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.579808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:10.582211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:10.596813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:10.598361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:10.599816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 406/820] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:10.604870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.679479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:10.682815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 415/821] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:10.773135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d764-c054-45b7-b38a-8648c07bae48 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.810207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:10.810838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:10.811114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:10.811378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:10.812108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:10.812405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:10.813826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:10.837061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 407/822] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:10.838499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:10.930074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:10.973840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c23d0-4616-4622-8ea8-7f7211271943 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:10.981681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.031796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.032421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.032698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.032966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.127950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291683-925a-45b4-8fa0-344a9acc3ebd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.143088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.149327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.151257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699010bb-1526-4574-830a-eb7a5ad10a86 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.175842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.176811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.177928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.178443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] PATH_INFO: `/v3/services/network` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.179368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.181557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-764a8584-1f96-4542-b726-296c2a5c7744 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:11.195389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:11.196456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:45:11.197374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:11.200146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 408/823] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:11.205714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1351-8f74-48b9-9a48-2b50921eb993 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.205714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1351-8f74-48b9-9a48-2b50921eb993 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.205714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1351-8f74-48b9-9a48-2b50921eb993 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.210854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 409/824] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:11.212784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb1351-8f74-48b9-9a48-2b50921eb993 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.245034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.286261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 416/825] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:11.289140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.289432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.289776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.314495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:11.316183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:11.349948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb1351-8f74-48b9-9a48-2b50921eb993 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.392074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.392702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.392984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.393258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.393950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] RBAC: Adding query filter params (name=network) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:11.394250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.395887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.400782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 417/826] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:11.401704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.407600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 410/827] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:11.414093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.450595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.518682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea9a1-2b74-421b-8df0-f5397a6614d8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.522893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.584980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.585768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.586044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.586310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.606914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.608359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.618926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0f2b-a12d-48ba-ac88-971f02426c93 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:11.641661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:11.642766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:11.643685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:11.643685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:11.643685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:11.650749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 418/828] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:11.651954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.663470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.664310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.664589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.664861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.670746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:11.670746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.670746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.673302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 411/829] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:11.681035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.795918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91180d55-4da9-47b6-a3bf-386559785e03 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.822397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.843269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4283-1110-46db-8a5e-7ede1021c2ed None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:11.847923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.848536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.848815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.849087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.849732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:11.850069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.851865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.865528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 419/830] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:11.867507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.885690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:11.887434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:11.888462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:11.888846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:11.889219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:11.889992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:11.892009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:11.985463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 412/831] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:11.985463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:11.985775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0168-5d16-4737-8237-880c04302b00 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.077543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.078201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.078471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.078754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.090987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:12.096094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:12.097131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:12.097990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 420/832] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:12.104475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.181044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:12.205589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbdfe-16d4-4e26-bffe-1fc55118fc22 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.215030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87117-3ce0-49c7-a463-c7ef12438adb None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.247008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40244-f303-4a21-978c-871752194636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.248191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40244-f303-4a21-978c-871752194636 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.248751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40244-f303-4a21-978c-871752194636 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.249223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b40244-f303-4a21-978c-871752194636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.250590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.251230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.251508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.251773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.252436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:12.252741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.254200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.260199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b40244-f303-4a21-978c-871752194636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.261957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b40244-f303-4a21-978c-871752194636 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.263917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 421/833] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:12.264204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:12.269410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-03b40244-f303-4a21-978c-871752194636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:12.278335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:12.279309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:12.280222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:12.282754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 413/834] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:12.289068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40244-f303-4a21-978c-871752194636 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.376405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415c60-0913-414e-863c-7e5e9d9008c5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.407074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:12.411060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b40244-f303-4a21-978c-871752194636 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.412014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.412673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.412956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.413224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.424506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.435266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:12.441669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:12.442670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:12.443631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:12.443631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:12.443631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:12.443631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 422/835] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:12.449343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.456095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.456968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.457462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.457928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.459876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:12.460554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.462308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.477622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 414/836] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:12.483134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.557956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:12.560037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d66fb-deb2-41d6-8b17-4e2c3a08a1d7 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.601924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.602617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196289d9-0832-4b0e-82bd-35ebd6de7a37 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.603139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.603616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.604271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.605889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:12.606415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.608050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a00ee-e5a5-4024-88fb-dfd4af4a6279 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.624553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 423/837] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:12.626506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccbe5-0813-4baa-bac6-97e83f53d91c None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.627077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccbe5-0813-4baa-bac6-97e83f53d91c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.627712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccbe5-0813-4baa-bac6-97e83f53d91c None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.629808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 424/838] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:12.630768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccbe5-0813-4baa-bac6-97e83f53d91c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.642048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.642711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.642954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.643225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.643957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:12.644268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.645697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af066-8d59-4e1d-a577-513b462727a8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.651923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 415/839] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:12.653118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.653400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.653672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.673332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:12.674584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:12.712974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:12.767894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 416/840] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:12.795055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccbe5-0813-4baa-bac6-97e83f53d91c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:12.838573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:12.839237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.839517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.839787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.849688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:12.851934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-55fda694-3bfc-4453-824f-723034d180a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:12.864466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:12.865436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:12.867156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 425/841] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:12.871488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:12.907360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7856-4db8-43f4-ad56-07a6d1104789 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.907667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7856-4db8-43f4-ad56-07a6d1104789 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.907886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7856-4db8-43f4-ad56-07a6d1104789 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.909213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 426/842] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:12.914754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:12.915026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:12.915294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:12.942489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:12.943732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:12.945745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.009485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19af11-c3ad-4a1c-90d3-c4815c28e005 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.029742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 427/843] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:13.050264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.050914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.051197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.051471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.052220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:13.052525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.054539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.072960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 417/844] 10.222.0.58 () {56 vars in 1135 bytes} [Thu Sep 1 17:45:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:13.074303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.078877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.113599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.187552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aaba7-6aaa-459e-98dd-9f7099386bf2 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.213307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab64d-c337-4055-bc8c-c5e2850f1264 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.225693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.226306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.226628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.226924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.227501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.229087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.230370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:13.239311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:13.246851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:13.247726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 428/845] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:13.248558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.263678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.264280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.264554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.264821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.365275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.367517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.388296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.391948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000704-5a19-4d59-a1bb-cf2a5d2924c3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.428447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.429577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.430393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.430672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.431347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:13.431654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.433022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.438044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 429/846] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:13.438921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.482118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 418/847] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:13.483404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.497403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.548626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d11f0b-ad21-4dda-a424-15d376162314 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.589192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.589808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.590077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.590341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.590449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b1bb-6eef-43bf-88af-66a729053496 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.600838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:13.605613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:13.606788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 430/848] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:13.607669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.632571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.635623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.636235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.636551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.636825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.637453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:13.637754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.639152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.647928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 419/849] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:13.647928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.738302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acade61-35ed-481d-bc95-77034524b383 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.771927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.792868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.793626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fcff-74c4-4f05-9738-69dd5415fd13 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.793751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.794109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.794473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.806067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.808232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:13.826374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:13.827508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:13.828452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:13.828452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:13.828452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:13.828452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 431/850] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:13.834551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.837929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:13.838545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:13.838883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:13.839157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:13.839841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:13.840143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:13.841523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:13.854850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 420/851] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:13.856955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:13.925476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:13.961796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cac03-1b51-4914-98e7-87867ad04a99 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:13.979027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df29cbe-a640-4723-a019-6a8af0452397 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.009472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.010187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.010940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.011293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.012268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:14.012637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.014320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.019910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.020802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.021264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.021713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.026350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.034532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 432/852] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:14.035515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.038659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.040715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:14.057438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:14.058766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:14.059959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:14.059959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:14.059959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:14.067362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 421/853] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:14.069421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.157984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a60e3-4c73-4038-835c-44928bd42091 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.182687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10298-99e7-4eeb-8cf6-2a39d4acf594 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.202274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.203335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.203680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.204020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.206026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.212971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.214825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.223276 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.224122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.224616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.225159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.225988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:14.226512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.228134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:14.229240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:14.230118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:14.231267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:14.235320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 433/854] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:14.237103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.253141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 422/855] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:14.254884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.326031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.366202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718507-77e6-4280-ba89-92dc3099a1d3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.383991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7df77-91b8-4307-a2d3-2ea3f169f557 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.408430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.409091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.409366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.409634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.410485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:14.410811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.412870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.425275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.426172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.426455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.426744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.429446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 434/856] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:14.436430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.440568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.442268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:14.456110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:14.457127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:14.458130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:14.465298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 423/857] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:14.466958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.500965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.552334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbf3af-df94-443a-80b3-e2c4f9999aa3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.601139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fcb3e-8e04-4a1a-90d8-b04761bb023a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.608434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.610173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.610752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.611581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.612654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.614213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=86f47c546d1b47d69252eaa11b5a3f24) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:14.614849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.617691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.626079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 435/858] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/role_assignments?user.id=86f47c546d1b47d69252eaa11b5a3f24&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:14.657071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.657768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.657964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.658232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.659163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:14.659467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.660966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8ea5-d354-48b5-bf46-8685475d4d06 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:14.684025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 424/859] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:14.690356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:14.720251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307142a-7a43-489f-9859-b7a6f06461ae None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.720539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307142a-7a43-489f-9859-b7a6f06461ae None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.720823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307142a-7a43-489f-9859-b7a6f06461ae None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.722502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 425/860] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:14.728593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.728887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.729168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.749350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:14.750521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:14.832882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dc6f5-259b-490a-a459-b26fddcac200 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:14.836136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 426/861] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:14.855732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:14.874163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:14.874899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:14.875180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:14.875438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:14.959231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:14.961863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.066258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 436/862] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:45:15.072305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.113302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.134036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.193483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.202422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc57b0-357c-43d9-a712-d883d3395acb None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.228686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107413d8-2c48-4cd9-ba62-efa4ef2dd345 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.250169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.250860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.251179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.251452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.267816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.269695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.274268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.274940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.275223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.275497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.276083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.277510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:15.288750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:15.289738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:15.295923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 437/863] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:15.296745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:15.297607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:15.298524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:15.298524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:15.298524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:15.298709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.299930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 427/864] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:15.302293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.397792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.417897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c65fd-673c-444a-9263-6df2761c24c0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.436575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f50cb-61c3-4b06-940c-bc9fbddeccb8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.461695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.462689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.463194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.463685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.464598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:15.465108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.466665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.477111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 438/865] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:15.478992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.481664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.482531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.483048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.483539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.484380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:15.484881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.486457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.499988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 428/866] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:15.505144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.516908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.612391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05ed2-37ab-426b-b2e4-b5ef5d2bf41f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.613945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edc310-0b73-496e-aaa2-216888f7283a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.654909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.655817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.656184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.656424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.656706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.657039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.657313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.657741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:15.657967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.658489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.659374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a199491-8e16-4214-8651-85decc911dbe None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.666787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 439/867] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:15.672357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.674181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.680128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11159-69f6-40e6-91a7-121d0077a0be None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.680443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11159-69f6-40e6-91a7-121d0077a0be None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.680678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11159-69f6-40e6-91a7-121d0077a0be None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.686669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 440/868] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:15.688111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.688392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.688662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:15.690684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:15.691677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:15.692623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:15.695102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 429/869] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:15.701340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:15.719159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:15.721327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:15.726744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.786800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:15.827113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 441/870] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:15.832497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0095fa-8b79-4fd0-803e-fc49f0c9d8d8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:15.872579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:15.873189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:15.873470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:15.873740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:15.874441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:15.874785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:15.876295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:15.891820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 430/871] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:15.898245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:16.005656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f84e0-5ebb-46ba-9e9c-d444c80bbdd6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:16.043507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:16.044444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:16.044974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:16.045440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:16.046355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=4461438f42034a62ae0b8923867c868c) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:16.046898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:16.048528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33749a5d-4e98-462c-982d-6fc69a17eba9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:16.055789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 442/872] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:15 2022] GET /identity/v3/role_assignments?user.id=4461438f42034a62ae0b8923867c868c&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:16.122652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:16.245893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2652d5b-1271-433e-85ee-5af449866a72 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:16.274712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:16.284218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:16.284820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:16.285092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:16.285356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:16.291471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:16.291471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5763a6d-b50e-48ee-82de-6e245ceeb7fd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:16.387206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 431/873] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:16 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:16.695204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e36cd-e526-4bfd-a1af-745952ed8520 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:16.695699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e36cd-e526-4bfd-a1af-745952ed8520 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:16.695699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e36cd-e526-4bfd-a1af-745952ed8520 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:16.697175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 443/874] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:16.702543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:16.703004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:16.703150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:16.723309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:16.724524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:16.802923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 432/875] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:17.096840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e36cd-e526-4bfd-a1af-745952ed8520 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:17.102255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:17.207236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e36cd-e526-4bfd-a1af-745952ed8520 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:17.244340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:17.244901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:17.245174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:17.245440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:17.246023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:17.247400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:17.257901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:17.258978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:17.260002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 444/876] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:17.267421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:17.383450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17a0a2-627b-47fc-b24a-4035efb22ea0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:17.402430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:17.424171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:17.424924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:17.425183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:17.425364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:17.425934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:17.426301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:17.427766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6e096-a204-4c98-aefc-8543ba9bd1fc None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:17.433439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 433/877] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:17.440813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:17.511957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:17.549555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ed269-f3b1-4b4f-9d28-3ad24f31bd19 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:17.590064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:17.590671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:17.590985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:17.591256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:17.591885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:17.592183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:17.593537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76c77-f649-4651-a079-26cf863fab69 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:17.598383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 445/878] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:17.789409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a1c4-7b58-4910-97eb-1013a7007f8b None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:17.789918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a1c4-7b58-4910-97eb-1013a7007f8b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:17.790015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a1c4-7b58-4910-97eb-1013a7007f8b None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:17.791573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 434/879] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:17.797043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba525-f4a1-4273-98ce-858db3264950 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:17.797468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba525-f4a1-4273-98ce-858db3264950 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:17.797564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba525-f4a1-4273-98ce-858db3264950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:17.817203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-460ba525-f4a1-4273-98ce-858db3264950 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:17.818390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-460ba525-f4a1-4273-98ce-858db3264950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:17.892646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 446/880] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:18.165908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3948a-b099-4ac5-b233-3c13255fdd74 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.166257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3948a-b099-4ac5-b233-3c13255fdd74 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.166361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3948a-b099-4ac5-b233-3c13255fdd74 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.167984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 435/881] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:18.173299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dfa5-782b-4c0d-a134-c4399820f545 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.173808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dfa5-782b-4c0d-a134-c4399820f545 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.174287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dfa5-782b-4c0d-a134-c4399820f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.177829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3948a-b099-4ac5-b233-3c13255fdd74 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:18.198756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3ff3dfa5-782b-4c0d-a134-c4399820f545 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:18.200035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3ff3dfa5-782b-4c0d-a134-c4399820f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:18.262159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:18.273572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 447/882] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:18.294905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3948a-b099-4ac5-b233-3c13255fdd74 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:18.330434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:18.331075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.331521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.331791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.332508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:18.333877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:18.375131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a790-a5db-4a5c-aa76-32bc9f82d4fd None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.375441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a790-a5db-4a5c-aa76-32bc9f82d4fd None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.375832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a790-a5db-4a5c-aa76-32bc9f82d4fd None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.377159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 448/883] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:18.382203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.382483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.382803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.403249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:18.404440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:18.423600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 436/884] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:18 2022] POST /identity/v3/services => generated 269 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:18.498256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 449/885] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:18.568093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:18.612368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:18.677184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ada133-cef3-494d-beff-d53bc035353d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:18.715279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:18.715932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.716213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.716487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.728001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:18.733482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:18.736298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:18.737161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 437/886] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:18.741446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:18.783263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:18.865364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0aa9-91ed-45cb-8dfc-ff1450fe1ed7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:18.885689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:18.903105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:18.903719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.904000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.904271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.904976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:18.905244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:18.906603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:18.914961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 450/887] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:18.916608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:18.920589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:18.922413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecc7e-dfc1-4e6a-96a9-91ceca1d6499 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:18.967958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:18.968998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:18.969366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:18.969730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:18.970947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:18.972961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:18.985874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:18.987050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:18.987919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:18.994622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 438/888] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:18.995700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.058271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee33b3-1984-4243-9234-9b3d06be7f42 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.096464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.097135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.097808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.098072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.104614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362deed-3c96-45c5-b6c2-826154732a84 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.117838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.119333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:19.141318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:19.142341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:19.143284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:19.143284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:19.143284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:19.150278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 451/889] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:19.151824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.160584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.161187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.161461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.161728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.162405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:19.162703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.164149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.169353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 439/890] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:19.174958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.196022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.210526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.269303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393656b-1fa1-4353-80b0-ece19b553ff5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.305786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27257-4e95-4a3f-b68e-1ebac495f018 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.312046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.312921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.313395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.314359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.315237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:19.315735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.318194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.339711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 452/891] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:19.341078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.349651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.350287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.350565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.350882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.351518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:19.351815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.353240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.362988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 440/892] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:19.364354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.471674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.475718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.481802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d44cb-5369-4eef-ac7d-fc880a4d5252 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.487679 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12b09-940f-481e-961d-4a1eecb5a364 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.528204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.528754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.529045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.529411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.530369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] RBAC: Adding query filter params (interface=public, service_id=e70315f304b54eb8964a37246be115c5, region_id=RegionOne) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:19.530693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.532410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.533476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.534346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.534868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.535361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.539777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 441/893] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/endpoints?service_id=e70315f304b54eb8964a37246be115c5&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:19.544721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.548645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.550387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9c9c979d-1cae-4327-9246-656cf78ab3d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:19.565086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:19.566082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:19.567110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:19.574746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 453/894] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:19.576030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266a58-ecd2-40bd-9bac-10afb89756dc None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.576319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266a58-ecd2-40bd-9bac-10afb89756dc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.576593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266a58-ecd2-40bd-9bac-10afb89756dc None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.577891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 454/895] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:19.578582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d266a58-ecd2-40bd-9bac-10afb89756dc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.663671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65181-1847-40bc-bee3-a9778d906d65 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.695605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d266a58-ecd2-40bd-9bac-10afb89756dc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.698872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.699483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.699763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.700033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.700640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.702009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34680396-f690-40ff-bb13-d6b1aae68cc2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.707964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 442/896] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:45:19.709074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.709402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.709848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.729565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:19.732925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:19.748182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.748867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.750469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.750986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.751496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:19.752450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:19.752930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:19.754577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:19.823289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 455/897] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:19.823289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:19.823289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:19.834887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 443/898] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:19.915978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb4e6-1563-4d0e-92c7-50cdc90743f9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:19.951384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:19.951991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:19.952264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:19.952528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.022755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.024326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.035738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:20.125366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.132990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 456/899] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:19 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:20.138616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.240012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2a5a-f01b-4741-809d-414dc88867f5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:20.251040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8e7a-6412-4bd0-a0e6-0ddd27251d27 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:20.262683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:20.290950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:20.291562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.291840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.292109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.292768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.294144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.296389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:20.297590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.298093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.299070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.310466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.311937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:20.327574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:20.328638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:20.330368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:20.330368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:20.330368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:20.331095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 457/900] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:20.334127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.383484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 444/901] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:20 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:20.456310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fae26-e1fc-4585-8a26-a7133e0ebd23 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:20.501557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:20.502608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.503149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.503637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.504556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:20.505073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.507282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7129c12-6367-4153-a475-bf4ffbcd6dc3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.521331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 458/902] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:20.528094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.531872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bed17-f6ad-4a62-b55e-b63ebac3ea58 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.532183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bed17-f6ad-4a62-b55e-b63ebac3ea58 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.532424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bed17-f6ad-4a62-b55e-b63ebac3ea58 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.533955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 459/903] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:20.539936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.540237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.540493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.543472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:20.561217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:20.562426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:20.578479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:20.646383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 460/904] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:20.656570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205d14-a0e3-4f1b-9095-a1adbb13d1c0 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:20.698058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:20.698698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.699008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.699281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.706290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.707809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:20.719654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:20.720598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:20.721889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 445/905] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:20.727473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.838455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beeffc-ba5d-4259-ae2a-e4e1f6e29c92 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:20.876039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:20.876823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:20.877251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:20.877618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:20.878407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:20.878832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:20.880408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:20.893644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 461/906] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:20.900439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.931465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:20.949903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:20.978107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:21.014764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc1293-cba1-4b91-99c3-f6c940e6243d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.056677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.057568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.057849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.058263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.059358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] RBAC: Adding query filter params (role.id=8b4126aabc1d44c0931e6e1b17cdec11, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=4461438f42034a62ae0b8923867c868c) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:21.059677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.061828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.065156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0178-e3d1-40a1-a66a-23be72db384c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.070286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 446/907] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/role_assignments?user.id=4461438f42034a62ae0b8923867c868c&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=8b4126aabc1d44c0931e6e1b17cdec11 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:21.113082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.113737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.114027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.114306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.114935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.116402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:21.126425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:21.127739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:21.128708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 462/908] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Sep 1 17:45:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:21.134117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:21.246633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2569f06-20b5-4097-8292-897615e29264 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.277154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:21.283380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.283950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.284228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.284498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.285194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:21.285495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.287148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.296670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 447/909] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:21.298009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:21.375106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:21.406411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd7df-8caf-4666-ab0e-1c14392b17bd None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.443096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.445892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.446172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.450763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.450763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:21.450763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.450763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.456895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 463/910] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:21.464833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:21.582632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adea984-4ca0-4c19-87f5-5a1f148f9af5 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.619134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.619915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.620301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.620648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.621359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] RBAC: Adding query filter params (interface=public, service_id=b7c832db53ca4dfc9540a5167863872d, region_id=RegionOne) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:21.621666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.623058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa80e-28df-47e1-8bfb-b3395ca47e5e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.628757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 448/911] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:21 2022] GET /identity/v3/endpoints?service_id=b7c832db53ca4dfc9540a5167863872d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:21.636037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:21.751377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6476-7396-4988-b215-38f3f70e5d61 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:21.782198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f563-7551-4216-8dce-35890d9ca335 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.782541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f563-7551-4216-8dce-35890d9ca335 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.782773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80f563-7551-4216-8dce-35890d9ca335 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.785415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 449/912] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:21.791147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:21.791759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.792035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.792308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.792914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:21.793136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:21.793603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:21.794075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:21.794265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:21.796158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:21.801057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 464/913] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:21 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:45:21.816198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:21.817848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:21.887258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:21.900800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 450/914] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:22.188600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:22.297355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa9a7-d97e-4017-966a-7f3cf945eced None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:22.333273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:22.334825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.335332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.335965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.336735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:22.338289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:22.347705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:22.348720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:45:22.349587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:22.352166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 465/915] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:22.358363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:22.464106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c1b3-b303-470b-963b-db6ceee56924 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:22.499610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:22.500581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.501067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.501571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.502404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:22.502952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:22.504525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747c8af-113d-4391-aec9-478357ab6b26 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:22.514933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 451/916] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:22.522814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:22.549115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18cd7-2a6d-45f5-8ee2-6602fbb8da4d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.549737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18cd7-2a6d-45f5-8ee2-6602fbb8da4d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.550200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18cd7-2a6d-45f5-8ee2-6602fbb8da4d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.552051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 452/917] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:22.557768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.558044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.558310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.578646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:22.580002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:22.597489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:22.646126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee62ff-89d2-4cda-ad3c-49e63fd782b9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:22.648530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:22.674764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 453/918] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:22.688396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:22.689053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.689333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.689603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.690237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:22.690539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:22.692073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:22.698669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 466/919] 10.222.0.58 () {56 vars in 1114 bytes} [Thu Sep 1 17:45:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:22.704257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:22.809152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7ea7-dab1-47bf-ad14-e97a8f60df58 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:22.845061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:22.846091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:22.846569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:22.847069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:22.847972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:22.849600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:22.947045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 454/920] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:22.958298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.077147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e26be-14ca-4903-ad1f-62e627b72639 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.106957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.120618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.123246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.123246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.123246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.123246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.123727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f71c5bb9-1774-48f4-bae3-494a7121f98f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:23.132976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:23.133989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:23.135098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 467/921] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:23.140145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.198138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.199290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418147d5-3fc7-480b-b4d4-9142fe6b2cf1 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.199728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418147d5-3fc7-480b-b4d4-9142fe6b2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.199938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418147d5-3fc7-480b-b4d4-9142fe6b2cf1 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.201458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 468/922] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:23.206447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.206748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.207146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.227398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:23.228594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:23.256857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51f66-8f68-4210-9303-a781531f6f2e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.301732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 469/923] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:23.306263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.306910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.307225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.307500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.308367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:23.308852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.311419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:23.316925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 455/924] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:23.323459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.437091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacdc1-20f9-462d-850b-265af76a5e2e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.458916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.478049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.478713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.479017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.479326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.479965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:23.480264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.481617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:23.486815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 470/925] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:23.493399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.592828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.614996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d402-3a68-443b-8953-e129bc5f5d5d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.618738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.652822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.653603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.653989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.654353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.655198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] RBAC: Adding query filter params (interface=public, service_id=e8dd6d7cc79740518e09edbcfc730b25, region_id=RegionOne) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:23.655606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.657185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:23.667130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 456/926] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/endpoints?service_id=e8dd6d7cc79740518e09edbcfc730b25&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:23.668543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.735619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f97a0-8cb9-437a-9d9a-0602ccc4cdb4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.774099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.774922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.775354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.775750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.786903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03077848-44bd-474c-bf10-23f58b633e22 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.787431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b3a4384c-ea55-4744-99d5-2d037fd2ca85 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:23.793813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:23.794842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:23.795746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:23.797199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 471/927] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:23.798531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4eea3-be25-4f96-8c98-dde340f6427c None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.798969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4eea3-be25-4f96-8c98-dde340f6427c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.799385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4eea3-be25-4f96-8c98-dde340f6427c None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.801382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 472/928] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:23.802320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4eea3-be25-4f96-8c98-dde340f6427c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:23.831942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.832814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.833269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.833534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.834922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.836286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474d84-2088-40ef-a542-d157c7f44923 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:23.842298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 457/929] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:45:23.843453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.843733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.844004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.851635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.872365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:23.873600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:23.910084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:23.928809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4eea3-be25-4f96-8c98-dde340f6427c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:23.975440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 458/930] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:23.992333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:23.993310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:23.993815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:23.994263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:23.995285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:23.995764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:23.997356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.007412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 473/931] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:24.012738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.117778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4addaf-fa57-42a8-ad07-ccf134df1bb0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.153434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.154072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.154349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.154620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.165755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.167254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:24.184131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:24.185430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:24.186333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:24.186333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:24.186333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:24.186333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 459/932] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:24.192702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.260506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.281691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.303816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbed60-25ac-4b27-9209-5e64cf4487d7 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.306790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.350199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.350864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.351148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.351428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.352075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:24.352378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.354559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.371497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 474/933] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:24.374129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79bb1-baf5-4fd0-8832-340b51ac3e6e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.383674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.426971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.426971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.426971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.426971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.427355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.427964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:24.440600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:24.441629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:24.442547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 460/934] 10.222.0.58 () {56 vars in 1132 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:24.448177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.513644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9321f24-c6e5-4cae-a062-411268bb73ca None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.535042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.550001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.552829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.552829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.552829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.559408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23acba-590f-4bef-a943-0e316922b79f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.560314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.561810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:24.574436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:24.575651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:24.576831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 475/935] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:24.583568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.603189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.604131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.604555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.605100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.605880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:24.606336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.607864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.611946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.614781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 461/936] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:24.621728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.713653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490325c-8b76-49b4-ab62-d961a0bebf8c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.734337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285ea6-c365-47ae-b11d-5a74753686f4 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.765037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.765771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.766146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.767068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.767683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:24.768093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.769658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.790547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.791471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.791884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.792370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.793255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:24.793757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.795379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.796128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 476/937] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:24.798820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.802335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 462/938] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:24.823786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:24.843238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.896051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:24.921231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b899e6-4357-4b5f-b22a-7eec5803acf4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.959283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed02b-10f9-411e-82be-ad7e1e5d3826 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:24.960419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.961226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.961649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.962117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.978541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:24.980257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:24.996559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:24.997231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:24.997509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:24.997781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:24.998257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:24.999207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:25.000127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:25.000127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:25.000127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.000299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.000299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042a944-86df-4c37-9935-ddd9933656a2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.002407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 477/939] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:25.010763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.104392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 463/940] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:25.105660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a599d8-5db9-45f5-a52a-e3caa6963dcf None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.105938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a599d8-5db9-45f5-a52a-e3caa6963dcf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.106209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a599d8-5db9-45f5-a52a-e3caa6963dcf None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.110781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 464/941] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:25.118198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.119170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.119722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.123406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e01ce-f0d9-44e8-8d61-5649de5ba0a6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.148605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:25.151328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:25.170221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:25.176963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.177594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.177934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.178764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.179775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:25.186347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.186347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.195690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 478/942] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:25.202260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.238707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:25.254142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 465/943] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:25.327001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b910f-f47f-4cb0-b8e1-686eddc24198 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.363582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.364134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.364408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.364675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.371714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.373129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:25.385959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:25.386951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:25.387918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.390842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 479/944] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:25.393240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.497866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b62af4-3c7d-44f7-9835-48a76cceea11 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.531349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.542293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.542944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.543226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.543508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.544205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:25.544507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.545954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.560985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 466/945] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:25.567233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.599276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:25.622835 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:25.652074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d09c1-2f2e-472d-8085-724d73176e7e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.677572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bbe7b-ad78-4dc5-ae34-63cf7b9b1926 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.689265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.689732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.690006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.690274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.690952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.692378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.695971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING keystone.server.flask.common [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 17:45:25.718412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.719192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.719468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.719733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/4461438f42034a62ae0b8923867c868c/roles/8b4126aabc1d44c0931e6e1b17cdec11` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.723987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=4461438f42034a62ae0b8923867c868c, role_id=8b4126aabc1d44c0931e6e1b17cdec11)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.723987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167453-0580-463e-bcec-cdecfebcd0ed None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.742713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.sql.core [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:45:25.742713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 17:45:25.742713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [parameters: {'id': 'e38c702defa542d28df0d3bf29257354', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 17:45:25.742713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81629) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e38c702defa542d28df0d3bf29257354.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e38c702defa542d28df0d3bf29257354. Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:45:25.759825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result.read() Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 17:45:25.760694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application yield resource Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise self.value Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application session.commit() Sep 01 17:45:25.761909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:45:25.763250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:45:25.764699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result.read() Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:45:25.766325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [parameters: {'id': 'e38c702defa542d28df0d3bf29257354', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.767968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:25.769503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e38c702defa542d28df0d3bf29257354. Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 480/946] 10.222.0.58 () {60 vars in 1140 bytes} [Thu Sep 1 17:45:25 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:25.773609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:25.809417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 467/947] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:25 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/4461438f42034a62ae0b8923867c868c/roles/8b4126aabc1d44c0931e6e1b17cdec11 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:45:25.891161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fade2-1eef-4358-a868-32f4723ab742 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:25.899311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:25.919110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cca25-7496-4982-bf56-024bf58ba6cb None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.919463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cca25-7496-4982-bf56-024bf58ba6cb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.919675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cca25-7496-4982-bf56-024bf58ba6cb None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.921294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 468/948] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:25.926691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.927115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.927501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.931401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:25.932053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:25.932332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:25.932598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:25.943535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:25.945748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:25.949092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:25.950397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:25.960669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:25.961663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:25.963357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 481/949] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:25.969217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:26.049738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 469/950] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:26.088871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1342b-de6f-4647-aa23-3ea8972b4b73 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:26.124998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:26.125608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:26.125888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:26.126175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:26.126943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:26.127247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:26.128709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:26.150519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 482/951] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:26.325113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:26.376533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:26.436577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9e80-5b18-430b-b505-8ea140b72fa6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:26.473491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:26.474124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:26.474399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:26.475333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:26.476108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:26.477489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:26.486297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:26.487402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:26.488705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 470/952] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:26.493645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:26.528798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:26.612745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b676e-739f-44cd-a48c-638d1838d80e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:26.649003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:26.649616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:26.649894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:26.650170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:26.650826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:26.651129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:26.652542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:26.657853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 483/953] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:26.663370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:26.769428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644bbc3-fbdc-4491-90c7-9eef6f233c9c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:26.778403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:26.806987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:26.807990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:26.808465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:26.808927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:26.809750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:26.810523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:26.812194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655b07-93a8-46d4-906a-575bcc03f673 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:26.817954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 471/954] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:26.828034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:26.923239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:26.934343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e6de-4586-4d3c-9d77-2545cf56ef96 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:26.972442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:26.973061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:26.973341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:26.973614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:26.974283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:26.975739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb460f4-a272-485b-ba6d-061b8a803667 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:27.055857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 484/955] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:27.231811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0c49-9b12-4f76-ae57-ffaff1fa224a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.232097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0c49-9b12-4f76-ae57-ffaff1fa224a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.232501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0c49-9b12-4f76-ae57-ffaff1fa224a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.233851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 472/956] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:27.239381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.239671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.239949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.260939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:27.262835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:27.343178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 485/957] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:27.625000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d0c49-9b12-4f76-ae57-ffaff1fa224a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:27.737206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d0c49-9b12-4f76-ae57-ffaff1fa224a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:27.774111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:27.774759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.775036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.775314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.775897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:27.777249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f5b09a8e-98d2-4241-a12f-5e6a5ff8377d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:27.786271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:27.787433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:27.788384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 473/958] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:27.795953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:27.874477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:27.899540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee6e6-3192-468f-b37a-e53db86e58cb None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.899733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee6e6-3192-468f-b37a-e53db86e58cb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.899990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee6e6-3192-468f-b37a-e53db86e58cb None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.901752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 474/959] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:27.906931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.907216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.907494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.912605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3d172-82a3-42a1-81fc-d126634bcc8f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:27.928771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:27.929997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:27.963145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:27.964061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:27.964552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:27.965319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:27.965827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:27.966545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:27.966945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:27.968370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:27.973857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 486/960] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:27.983351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.012266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 475/961] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:28.092459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63566da3-2b2e-4a75-a2fa-c38f76090c04 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.128082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:28.128690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.128969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.129242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.129881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:28.130183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:28.131617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a455-2bad-42af-a987-9890c4d71c30 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:28.133658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:28.136613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 487/962] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:28.289780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.347931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecf91-d4f3-47a4-ae41-2d97ca4bdefe None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.348202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecf91-d4f3-47a4-ae41-2d97ca4bdefe None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.348477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecf91-d4f3-47a4-ae41-2d97ca4bdefe None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.350674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 488/963] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:28.355732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.356015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.356283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.374518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:28.375722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:28.405077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff5a69-bfe9-4040-8fac-ae974e4a408e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.450816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 489/964] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:28.456520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:28.457393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.457857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.458308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.469831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:28.475205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:28.476172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:28.477080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:28.479887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 476/965] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:28.485897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.595134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8c52a-a67b-4d34-a81d-8053087cfe53 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.626604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:28.634372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:28.635198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.635754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.636176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.641210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:28.641210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:28.641210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:28.648571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 490/966] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:28.654437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.687234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:28.739571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.776950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e006-4220-479d-8f59-e40f20f84ecd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.826128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:28.826801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.827549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.827829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.843083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:28.845303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:28.858756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b615b-7ee6-411f-9f8c-ba4ae4885dba None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:28.864866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:28.865946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:28.866937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:28.866937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:28.866937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:28.870803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 477/967] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:28.874147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:28.910631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:28.911929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:28.913314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:28.913799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:28.914653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:28.916315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:28.966975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:28.985195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.sql.core [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:45:28.985195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 17:45:28.985195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [parameters: {'user_id': '7e77ad839f724784a1c39e08f266c8d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 17:45:28.985195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81629) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:45:28.990929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef376-865d-408a-8ddd-c7ec82fb65fb None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result.read() Sep 01 17:45:28.995820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:45:28.996695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application yield resource Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise self.value Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application session.commit() Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:45:28.997713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:45:28.998629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:45:29.000097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application result.read() Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:45:29.001186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [parameters: {'user_id': '7e77ad839f724784a1c39e08f266c8d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:29.002227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 17:45:29.003264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 17:45:29.004504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:29.007289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 491/968] 10.222.0.58 () {60 vars in 1131 bytes} [Thu Sep 1 17:45:28 2022] POST /identity/v3/users => generated 160 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:29.013418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.047232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.048412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.049137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.050052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.051253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:29.052003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.054279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.075740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 478/969] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:29.077522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.093446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.144290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbb49-ebdc-4033-8ba1-8bff18e27a2f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.192491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.193137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.193418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.193684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.196623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36370-0598-4605-95e3-fd004d0f21f7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.211139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.213704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-9626ef26-39be-4d7a-977d-b61b5671dc9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:29.227547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:29.228604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:29.229606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 492/970] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:29.230239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6a5a-6d5d-4fb9-a643-70616ce74d01 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.230239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6a5a-6d5d-4fb9-a643-70616ce74d01 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.230379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6a5a-6d5d-4fb9-a643-70616ce74d01 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.234487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 493/971] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:29.235021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6a5a-6d5d-4fb9-a643-70616ce74d01 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.251070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.251978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.252442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.252716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.255978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.261294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.262765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d9c5101b-c51d-469c-98d1-ecb07b9d830f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:29.275023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:29.276033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:45:29.276988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:29.281044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 479/972] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:29.282239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.282518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.282808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.302047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:29.303688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:29.347359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6a5a-6d5d-4fb9-a643-70616ce74d01 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.362341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.379068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 480/973] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:29.379068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.386683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.390364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.431665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 494/974] 10.222.0.58 () {56 vars in 1101 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:29.504860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646c5a-4565-4709-9279-1ff7cf6d2d6f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.535593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.550595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.551552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.551984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.552403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.553362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:29.553866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.555586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.578458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 481/975] 10.222.0.58 () {56 vars in 1149 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:29.585789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.670962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.696895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3342d2-b2c2-4782-8220-2e48a6227646 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.743194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.743805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.744079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.744341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.789602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.791091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86512a33-68c1-4f33-90d2-27362872aa9d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.816571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.818020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.827895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.828557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.828833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.829100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.829734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.831173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:29.840895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:29.841924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:29.842817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 482/976] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:29.848052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.899791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:29.930820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 495/977] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:45:29.935262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:29.956683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80534958-0a02-46d6-87e9-2c408ea9cb73 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:29.993371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:29.994302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:29.994607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:29.994893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:29.995534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:29.995859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:29.997721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.003118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 483/978] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:30.009390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.018155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.049443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff5bcc-7606-4bed-9851-adca51083804 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.087353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.087973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.088360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.088624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.099139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.101019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.109224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30403e4b-254b-49fb-b5e8-010c865e6fbd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:30.117013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:30.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:30.119412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:30.119412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:30.119412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:30.119412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 496/979] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:30.123765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.126346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.148635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.149241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.149519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.149788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.150416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:30.150712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.152108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209497a3-86b1-4f26-9372-d79b38d83f2b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.157350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 484/980] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:30.158603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054310ec-5417-43b2-8638-068c0287274c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.158925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054310ec-5417-43b2-8638-068c0287274c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.159196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054310ec-5417-43b2-8638-068c0287274c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.160491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 485/981] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:30.162903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054310ec-5417-43b2-8638-068c0287274c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.229534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1808e2-e1be-4f0b-950c-0fd962dd2e7c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.254329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.264680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.265281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.265556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.265820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.266452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:30.266774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.268136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c0b17-5047-45cf-bda4-776a067191e8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.272980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054310ec-5417-43b2-8638-068c0287274c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.279838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 497/982] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:30.281011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.281285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.281549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.300017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:30.301534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:30.308036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.308639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.308912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.309179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.310133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] RBAC: Adding query filter params (interface=admin, service_id=e8dd6d7cc79740518e09edbcfc730b25, region_id=RegionOne) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:30.310433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.311832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.316681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 486/983] 10.222.0.58 () {56 vars in 1249 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/endpoints?service_id=e8dd6d7cc79740518e09edbcfc730b25&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:30.317440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.358881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.369791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 498/984] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:30.374974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.427730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbcef-a279-47ba-aa31-3236f6b1cdc8 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.465432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.466133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.466420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.466675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.470293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e3de-ac30-439f-8aac-dae8b91d7a44 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.473332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.475318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.486232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:30.486591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:30.487745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:30.488854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 487/985] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:30.496259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.516053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.516656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.516932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.517197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.517800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.519176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.525762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 499/986] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:45:30.606789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:30.610429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303248-ae4c-4c98-afe4-ace0d7dd0484 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.642349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.648551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.649263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.649619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.649958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.650789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:30.651129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.652660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.667899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 488/987] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:30.674535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:30.753357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a407a9-413d-43a1-b312-413ea747c870 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.784786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e710-1a48-4a05-8de3-840e39a9da30 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:30.790928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.791543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.791824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.792093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.792744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.794114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9e865-6747-481b-b6bc-5f067050b72a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.821008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:30.821610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:30.821889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:30.822163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:30.822924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] RBAC: Adding query filter params (role.id=8b4126aabc1d44c0931e6e1b17cdec11, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=4461438f42034a62ae0b8923867c868c) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:30.823232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:30.824745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6c669-8691-4c48-a03b-c78ee95880e8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:30.830574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 489/988] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:30 2022] GET /identity/v3/role_assignments?user.id=4461438f42034a62ae0b8923867c868c&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=8b4126aabc1d44c0931e6e1b17cdec11 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:30.884177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 500/989] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:30 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:32.470555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f764d7-096a-4372-8706-642be6219823 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.471153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f764d7-096a-4372-8706-642be6219823 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.471153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f764d7-096a-4372-8706-642be6219823 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.472486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 490/990] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:32.478479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183fac-3632-473f-b7f1-1ecb369e5ed5 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.478965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183fac-3632-473f-b7f1-1ecb369e5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.479223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90183fac-3632-473f-b7f1-1ecb369e5ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.497449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-90183fac-3632-473f-b7f1-1ecb369e5ed5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:32.498646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-90183fac-3632-473f-b7f1-1ecb369e5ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:32.529829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:32.581700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 501/991] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:32.796387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b922f-25e2-4de4-bf22-64e7700f8925 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.796747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b922f-25e2-4de4-bf22-64e7700f8925 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.796948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b922f-25e2-4de4-bf22-64e7700f8925 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.798425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 491/992] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:32.803792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.804151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.804436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.823732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:32.824912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:32.827393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa49e-c03c-4eeb-9b9d-835a108f964c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.827680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa49e-c03c-4eeb-9b9d-835a108f964c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.828815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa49e-c03c-4eeb-9b9d-835a108f964c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.830162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 492/993] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:32.835866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:32.836144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:32.836412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:32.854213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:32.855910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:32.874422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:32.910877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 502/994] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:32.911733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:32.928730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 493/995] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:33.019090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.025735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d9ff-9d82-49a3-85fb-4c8155d1ba98 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.060500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.061054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.061331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.061601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.062184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.063573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:33.072990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:33.074003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.075846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 503/996] 10.222.0.58 () {56 vars in 1126 bytes} [Thu Sep 1 17:45:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:33.080068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.182594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e06a3-084a-4041-ac69-a8b28d5db5b1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.202366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.217440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.218050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.218327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.218593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.219259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.219569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.220916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.226485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 494/997] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:33.227294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.250061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.304227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59e9d-77df-4a25-955e-a57d7818c62e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.333096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b11b-ef36-45a3-ada0-9780234ccdca None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.338469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.339118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.339398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.339663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.340235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.341696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:33.350823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:33.352018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:33.352897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 504/998] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:33.353717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.369515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.370142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.370421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.370693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] PATH_INFO: `/v3/services/image` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.371307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.372673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.378413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:33.382140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:33.383221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:33.384090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:33.388101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 495/999] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:33.388927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.454887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ee69-2095-4761-915d-c396c09b3c2a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.470999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.488844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.489559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.489662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f676a-26d2-4c7b-a230-e1d37e90311d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.489839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.490791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.491426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.491723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.493076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.498234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 505/1000] 10.222.0.58 () {56 vars in 1122 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:33.498892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.524596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.525295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.525633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.525963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.526653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.527052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.528411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.533033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 496/1001] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:33.533773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.591509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.606485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688f93-f659-440e-a100-436949ceaf82 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.640190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115dc30-90e2-4bb5-a9b6-7313746506ef None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.641629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.642229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.642505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.642796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.643420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] RBAC: Adding query filter params (name=image) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.643718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.645066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.649762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 506/1002] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:33.650526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.677354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.678542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.678834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.679107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.679758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.681114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.747313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc96c2-cdb6-49e5-b0f8-56ea577f0f39 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.754003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 497/1003] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:33.754912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.765168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.840596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.841218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.841577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.841787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.842418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.843042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.844111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.855549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 507/1004] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:33.857062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:33.870579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedab23-a333-4147-ae93-37a97c88d431 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:33.871483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:33.912997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:33.913612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:33.913886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:33.914811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:33.914811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] RBAC: Adding query filter params (type=image) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:33.915106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:33.916488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:33.921389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 498/1005] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:33.986479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09b58-fc56-48d3-bc2e-777e4e571c00 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:34.026824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:34.027450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:34.027730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:34.027999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:34.028710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] RBAC: Adding query filter params (interface=public, service_id=f51b3aace1b94b168743d2d780caf389, region_id=RegionOne) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:34.029018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:34.030469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd0614-4c28-4c3c-bf25-cbd0bb12c8a2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:34.041064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 508/1006] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:33 2022] GET /identity/v3/endpoints?service_id=f51b3aace1b94b168743d2d780caf389&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:34.042854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:34.120225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:34.151350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddfa-11f8-401f-8033-2f5c15be5b0f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:34.188124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:34.188798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:34.189083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:34.189356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:34.189966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:34.191374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520240-f574-4b05-a6ce-f20b8af031a7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:34.206762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 499/1007] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:34 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:45:35.731254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a3b2-adf6-4b5e-b3b5-ef2e0c41ef1e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:35.731785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a3b2-adf6-4b5e-b3b5-ef2e0c41ef1e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:35.731785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a3b2-adf6-4b5e-b3b5-ef2e0c41ef1e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:35.734997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 509/1008] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:35.738351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb07a-f916-4aa3-aea5-2ad2cee425f3 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:35.738854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb07a-f916-4aa3-aea5-2ad2cee425f3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:35.738946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb07a-f916-4aa3-aea5-2ad2cee425f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:35.759568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-873cb07a-f916-4aa3-aea5-2ad2cee425f3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:35.760188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-873cb07a-f916-4aa3-aea5-2ad2cee425f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:35.867376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 500/1009] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:35.869560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b6dd-367f-40f7-b76c-4c128834e371 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:35.869847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b6dd-367f-40f7-b76c-4c128834e371 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:35.870123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14b6dd-367f-40f7-b76c-4c128834e371 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:35.871595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 510/1010] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:35.876436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c0163-5a5e-422c-bb90-dbcda3276e5f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:35.876726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c0163-5a5e-422c-bb90-dbcda3276e5f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:35.877003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c0163-5a5e-422c-bb90-dbcda3276e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:35.895880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8b7c0163-5a5e-422c-bb90-dbcda3276e5f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:35.897301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8b7c0163-5a5e-422c-bb90-dbcda3276e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:35.964123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:35.972625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 501/1011] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:36.117987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b344-7444-46b4-9c6b-16da3833ad01 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.118358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b344-7444-46b4-9c6b-16da3833ad01 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.118523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1b344-7444-46b4-9c6b-16da3833ad01 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.120039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 511/1012] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:36.125035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.125320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.125593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.138933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1b344-7444-46b4-9c6b-16da3833ad01 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.145683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:36.146955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:36.216977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:36.230869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 502/1013] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:36.243495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.244001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1b344-7444-46b4-9c6b-16da3833ad01 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.280895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.281524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.281807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.282076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.283221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.284638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:36.286215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 512/1014] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:36.291907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.355110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c663b81-172f-4cf4-8157-e5083e2cfec9 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.378979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:36.390397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.391215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.391489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.394909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.394909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.394909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:36.395420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154beb-8d91-4004-be7d-f945842bdae1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.430316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.430938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.431214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.431479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.432141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.433555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:36.448349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:36.483137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 503/1015] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:36 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:36.485468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.572532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 513/1016] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:45:36 2022] POST /identity/v3/projects => generated 311 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:36.610460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488adc2-dbda-4769-99c3-6f3a293b04fc None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.655355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.655932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.656212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.656482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.657084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.658487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:36.669690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:36.671042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:36.672152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 504/1017] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:36.677081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.789556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50113c-2b6d-4dd8-8eb3-ba94eec8ba8a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.824833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.825442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.825716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.825980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.826608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:36.826939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.828278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:36.833343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 514/1018] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:36.839512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:36.889228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:36.947033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fd20c-1ca6-46b8-a88e-830b576c3aeb None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:36.992106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:36.992731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:36.993011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:36.993282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:36.993976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:36.994286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:36.995699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2276-a169-4f67-94d8-25470ca16ac6 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:37.001704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 505/1019] 10.222.0.58 () {56 vars in 1112 bytes} [Thu Sep 1 17:45:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:37.006626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:37.067804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:37.111688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552de7-46a3-4dfc-bd01-29e64d9c69d4 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:37.146157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:37.147196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:37.147688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:37.148157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:37.149021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:37.150617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d41df-3e8b-4581-84f5-a276e0ad6093 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:37.222619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 515/1020] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:38.517782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb708a-951f-440e-82a4-09485d8d1209 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:38.518346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb708a-951f-440e-82a4-09485d8d1209 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:38.518346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb708a-951f-440e-82a4-09485d8d1209 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:38.519857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 506/1021] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:38.525849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:38.526252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:38.526427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:38.545492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:38.546672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:38.568947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8709ff-be03-451e-95b4-573dca86dc67 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:38.569230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8709ff-be03-451e-95b4-573dca86dc67 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:38.569499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8709ff-be03-451e-95b4-573dca86dc67 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:38.574449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 507/1022] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:38.576779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:38.577262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:38.578021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:38.601246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:38.602515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:38.628950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 516/1023] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:38.673976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 508/1024] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:38.921004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:38.946930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:38.968603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:38.993147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.030257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb29c44-480a-41b5-891e-2e3f41fe6e88 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.058432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950642-b365-418d-ab28-ba8c19ad72f6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.064545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.065180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.065461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.065732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] PATH_INFO: `/v3/services/image` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.066319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.067748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:39.077655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:39.078762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:39.080257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 517/1025] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Sep 1 17:45:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:39.084858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.100809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.101443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.101721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.101996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.103136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.104567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.106311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 509/1026] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:39.111644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.191445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc82a1-f0cc-4bab-90e2-ee2e7efe7b94 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.194341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.225092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d161a-191c-4794-9b13-c1d3783bc35e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.233085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.233363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.233972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.234264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.234537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.235199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] RBAC: Adding query filter params (name=image) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:39.235502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.236861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a8e2a-265a-4b58-bf9e-f92ecd84c679 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.242410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 518/1027] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:39.243750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ff8f-bbfd-43ce-8b3b-ebac5377bfe8 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.244036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ff8f-bbfd-43ce-8b3b-ebac5377bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.244306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ff8f-bbfd-43ce-8b3b-ebac5377bfe8 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.247985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 519/1028] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:39.247985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13ff8f-bbfd-43ce-8b3b-ebac5377bfe8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.261439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.262038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.262313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.262652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.263525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.265417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c5b33-232d-43c9-9ca1-4fe482605d63 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.350557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13ff8f-bbfd-43ce-8b3b-ebac5377bfe8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.356717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 510/1029] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:45:39 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:39.357948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.358230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.358499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.379741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:39.381090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:39.389425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.390345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.390627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.390931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.391583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] RBAC: Adding query filter params (type=image) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:39.391891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.393422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.404135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 520/1030] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:39.405414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.442624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.462563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 511/1031] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:39.531973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a74a3-da3a-4038-b1bc-fcc258305650 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.569848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.570459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.570750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.571046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.571759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] RBAC: Adding query filter params (interface=public, service_id=14c53b67f8c74f8987f664d0153697e6, region_id=RegionOne) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:39.572068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.573422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.580026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 521/1032] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/endpoints?service_id=14c53b67f8c74f8987f664d0153697e6&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:39.586317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.683750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.693132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c638d-3b09-4bf4-a214-8f7e804139ed None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.729210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.729854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.730135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.730406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.731031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:39.732390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:39.739611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 512/1033] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:45:39.742278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:39.860648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:39.867608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aacc7-3914-4354-b17c-87b24fb9318c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:39.918906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:39.919544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:39.919822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:39.920089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:39.938438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:39.945616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:39.946663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:39.947990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:39.951104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 522/1034] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:39.953370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:40.076403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60894c3-44b0-4273-8da5-2ff9fecd3db9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:40.115894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:40.116498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:40.116775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:40.117066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:40.117919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:40.118221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:40.119639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:40.136141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 513/1035] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:40.138450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:40.278174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324779-b58d-4cca-ba0c-ad06027cafdc None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:40.326593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:40.327254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:40.327593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:40.327865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:40.339912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:40.341861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:40.358532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:40.359606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:40.365818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:40.365818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:40.365818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:40.365818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 523/1036] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:40.367438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:40.395660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:40.492427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce90a2a-560a-4753-87af-017cfb706bd1 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:40.532675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:40.533204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:40.533479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:40.533888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:40.534977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:40.535286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:40.536714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:40.554782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 514/1037] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:40.558265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:40.577955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:40.688445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1805cf-3b79-42e5-a7db-d178be1d4580 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:40.734010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:40.734646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:40.734957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:40.735255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:40.744832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:40.746275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:40.759207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:40.765960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:40.767240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 524/1038] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:45:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:40.768401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:40.866090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:40.895786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659920-51ad-4512-9f49-9630e47e543a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:40.932179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:40.935416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:40.935416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:40.935416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:40.935416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:40.935416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:40.936293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:40.960938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 515/1039] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:40.962285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:41.032769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:41.070348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b261c-1dc7-43b3-9741-c3462fb7404c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:41.105726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:41.106336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.106608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.106905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.174522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:41.175910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:41.242892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:41.277767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 525/1040] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:45:41.283526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:41.391062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11632f95-80ce-4453-b65d-d88ac1210189 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:41.427721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:41.428278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.428556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.428826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.432074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:41.440816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:41.442443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-f50cb191-6e7f-47c5-9452-1ee825387a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:41.457584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:41.464132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:41.465129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:41.465129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:41.465129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:41.465129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 516/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:41.465361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:41.565680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc5151-b80b-4828-ba61-525baefbffec None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:41.571975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8769-ff76-44db-acdb-3ecd50875309 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.572259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8769-ff76-44db-acdb-3ecd50875309 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.572533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8769-ff76-44db-acdb-3ecd50875309 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.574083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 517/1042] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:41.578630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.578941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.579208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.598290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:41.599557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:41.605888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:41.606502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.606811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.607138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.607787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:41.608094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:41.609540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:41.621445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 526/1043] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:41.626906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:41.660887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:41.674704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 518/1044] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:41.746074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234d9cf-13e2-4a19-9d9a-67cbf8bb0856 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:41.780955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:41.781857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.782310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.782891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.789885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:41.791546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-345204f6-8db4-47c5-9848-2babd496a91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:41.803153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:41.804080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:41.805001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:41.811756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 527/1045] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:41.812779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:41.895411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938cd6f-98b3-4a4e-86fc-3354fa68b552 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.895703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938cd6f-98b3-4a4e-86fc-3354fa68b552 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.895979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938cd6f-98b3-4a4e-86fc-3354fa68b552 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.897600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 528/1046] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:41.902203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.902490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.902807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.920619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00a1d-899f-4a89-b423-b5d7e2484664 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:41.920791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:41.921931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:41.941379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:41.961793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:41.961793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:41.961793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:41.961793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:41.962327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:41.962416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:41.963860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:41.976200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 519/1047] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:41.977032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.000869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 529/1048] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:42.001743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.020631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.085136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f332-4181-4fb0-89a3-8155af77de06 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.108898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992597d-f436-496b-8d0a-427f0e930344 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.119403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.120017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.120298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.120569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.131922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:42.136799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:42.137747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:42.138798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 520/1049] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:42.143860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.151388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.151994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.152281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.152549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.153273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] RBAC: Adding query filter params (role.id=8b4126aabc1d44c0931e6e1b17cdec11, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:42.153870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.155025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.160618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 530/1050] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=8b4126aabc1d44c0931e6e1b17cdec11 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:42.191589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.259346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0097dc-44ce-4ebc-8232-985f3f722f48 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.272258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.300852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.301937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.302216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.303184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.303926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:42.304234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.305623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.319095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 521/1051] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:42.324547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.364146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.382503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d161-27aa-4296-a35e-09a9e953cf7e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.418047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.418682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.418983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.419250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] PATH_INFO: `/v3/services/image` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.419830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.421179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.429023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:42.430689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:42.431807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:42.432693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 531/1052] 10.222.0.58 () {56 vars in 1105 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:42.435676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbab07-9d11-4977-b31a-1289f80e521e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.437893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.472747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.473527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.473803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.474083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] PATH_INFO: `/v3/users/428b7002df8f45ab9c6aa2eb28205951` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.489531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] RBAC: Authorizing `identity:get_user(user_id=428b7002df8f45ab9c6aa2eb28205951)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.491645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.493694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 522/1053] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/users/428b7002df8f45ab9c6aa2eb28205951 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:42.499584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.546920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241add0-caf7-4aeb-926e-1581dc87da48 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.582245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.582937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.583522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.583522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.584561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] RBAC: Adding query filter params (name=image) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:42.584864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.586227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.591764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 532/1054] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:42.597418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.612143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.613135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560756-898a-4624-a8ba-bca40edc4cfa None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.649019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.649998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.650517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.651035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.685162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.709846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e0a-7dad-4123-849a-0a2b0dc69e91 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.742095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.743600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.745976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.747366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.747858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.748309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.749122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:42.749618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.751368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.762336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 533/1055] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:42.763820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.847333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.847891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 523/1056] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:45:42.854517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:42.876608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922f0-8a02-4fa5-8123-641801addce2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:42.912994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:42.913917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:42.914433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:42.914933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:42.915774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:42.917331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d87d-212d-48fe-b2e9-e792e7be79ad None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:42.917642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:42.969337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288c34-9caf-465e-ac6f-77abe28b9127 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:43.003868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:43.004489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:43.004791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:43.005082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:43.006247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:43.007754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:43.009365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 524/1057] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:45:42 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:43.015570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:43.028794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 534/1058] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:45:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:45:43.133956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415c18-54a4-4bb3-9a1e-60ea4a91528d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:43.162637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:43.178578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:43.179255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:43.179526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:43.179787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:43.180505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=f2dc58781e7747ddac2354793bc05260, user.id=428b7002df8f45ab9c6aa2eb28205951) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:43.180804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:43.182221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188aed-778c-4fcb-97cf-9e9085741ee5 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:43.188366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 525/1059] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:43 2022] GET /identity/v3/role_assignments?user.id=428b7002df8f45ab9c6aa2eb28205951&scope.project.id=f2dc58781e7747ddac2354793bc05260&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:44.094312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2901-8453-457a-b4e1-a7ccf6661aea None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.095067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2901-8453-457a-b4e1-a7ccf6661aea None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.095067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2901-8453-457a-b4e1-a7ccf6661aea None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.096361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 535/1060] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:44.102028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.102443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.102607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.120710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:44.121883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:44.190427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 526/1061] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:44.492653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f2901-8453-457a-b4e1-a7ccf6661aea None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:44.597658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f2901-8453-457a-b4e1-a7ccf6661aea None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:44.626598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:44.633366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:44.633999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.634272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.634535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.644580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:44.649606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:44.650564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:44.651769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:44.654389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 536/1062] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:44.656807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:44.767303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854547-7007-40b8-89bd-c2818374baf7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:44.785534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:44.804231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:44.804841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.805122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.805392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.806056 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:44.806360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:44.807771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781f18-e196-41ca-aaaf-78b89d83d164 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:44.818903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 527/1063] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:44.822524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:44.926916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634998a-e5c5-4ac0-b7c9-0d8d8b40a6e9 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:44.968051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:44.968689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.968966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.969235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.979972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:44.981416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:44.988547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc019-a222-4c6d-aa70-143fff14222a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.988833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc019-a222-4c6d-aa70-143fff14222a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.989111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc019-a222-4c6d-aa70-143fff14222a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:44.994523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 528/1064] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:45:44.996147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174015-fe9e-4022-abb5-19044f11625f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:44.996442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174015-fe9e-4022-abb5-19044f11625f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:44.996719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174015-fe9e-4022-abb5-19044f11625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:45.000367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:45.001307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:45.002225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:45.002225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.002225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:45.003080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 537/1065] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:45.007795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.016411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e9174015-fe9e-4022-abb5-19044f11625f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:45.017673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e9174015-fe9e-4022-abb5-19044f11625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:45.056493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.091669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 529/1066] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:45.122315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcdc4-4f5d-440d-b20e-4e27364b24ec None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.156658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533103-a01f-46b7-9b2e-846028ea952c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.157155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533103-a01f-46b7-9b2e-846028ea952c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.157338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533103-a01f-46b7-9b2e-846028ea952c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.157980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.158590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.158943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 530/1067] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:45.159074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.159221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.159869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:45.160231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.161587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.164452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.165066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.165066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.181128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 538/1068] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:45.182400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.187731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:45.189005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:45.264637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 531/1069] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:45:45.288343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce158c-a23d-4a64-92ae-d956f72d7ab8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.290216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.322910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.323527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.323804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.324069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.331082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.332695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:45.345794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:45.346879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:45.348311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:45.351096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 539/1070] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:45.353304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.360704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.395839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.457693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d01c-b82b-45c1-8a5c-03193ac4ba47 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.464279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37a0bb-7d9f-4e94-bed4-d604479479ad None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.492269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.492967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.493240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.493503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.494224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:45.494531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.496060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.501695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.502469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.502946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.503360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.513128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 532/1071] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:45.518558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.534185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.576183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.577596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.616903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.622434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3445eb-639c-4aac-a7aa-ef95dfb201ca None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.655968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.656586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.656866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.657133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.667740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.669420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.675301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 540/1072] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:45.677459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:45.684630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:45.686041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:45.687015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:45.687015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.687015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:45.690648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 533/1073] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:45.691456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.739283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.783273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4621d81-e06c-467f-a88f-1747e9fc2d07 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.800309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8fed-aaa7-405d-a202-7bcc45929263 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.817087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.817707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.818024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.818294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.828059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:45.833212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:45.834670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:45.835583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:45.836538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.836635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 541/1074] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:45.836706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.836706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.836846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.836923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.847614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.849046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.857654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:45.864255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:45.865475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:45.866424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:45.866424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:45.866424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:45.866424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 534/1075] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:45.866657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:45.939759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364a1c5-c341-4a77-befa-6976fe8f33ba None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.962779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:45.973475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20292e0d-111c-4890-a4e7-68fddd080d40 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:45.973902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:45.975252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:45.975527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:45.975894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:45.976542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:45.976833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:45.978177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:45.989599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 542/1076] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:45.990691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.009891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.010497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.010806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.011081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.011758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:46.012069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.013473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.022063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 535/1077] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:46.022900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.087291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:46.093170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78b4fa-b54f-474d-8eaf-226a0a7c1075 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.126838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c6ac-a621-46af-9ea5-043a1a81663d None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.127692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.128305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.128580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.128846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.129488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:46.129786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.131292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.142583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 543/1078] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:46.143333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.174396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.175444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.175723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.176277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.186482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.188889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.192125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:46.205202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:46.206473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:46.207524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 536/1079] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:46.212766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.269632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362ecb2-e44b-494e-bcbe-1abf83a19a22 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.312564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.313190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.313467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.313734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] PATH_INFO: `/v3/users/428b7002df8f45ab9c6aa2eb28205951` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.315486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] RBAC: Authorizing `identity:get_user(user_id=428b7002df8f45ab9c6aa2eb28205951)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.316899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.318550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 544/1080] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:46 2022] GET /identity/v3/users/428b7002df8f45ab9c6aa2eb28205951 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:46.324637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.335857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebe33e-aaf6-439b-8efc-4cbe4f3b2abd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.365131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:46.384512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.385241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.385589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.385930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.386754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:46.387059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.388560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.404070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 537/1081] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:46.410307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.444886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc49b6-c6e2-42a8-82e3-6fe91594cdaf None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.455130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:46.479366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.479993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.480268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.480535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.481763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.483194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.484968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 545/1082] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:45:46 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:46.491479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:46.513373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9993a8-41fd-44bb-b91c-5513fb726f0e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.549483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.550131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.550407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.550676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/8b4126aabc1d44c0931e6e1b17cdec11` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.553338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=716bdc59d9eb46398492fdea1759ed7a, role_id=8b4126aabc1d44c0931e6e1b17cdec11)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.554808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb233-c419-4ff8-836e-f3ce805ebe74 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.590540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f31ac-e0c1-4df4-889d-aad615633766 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:46.623307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:46.623847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:46.624128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:46.624399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260/users/428b7002df8f45ab9c6aa2eb28205951/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:46.626301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2dc58781e7747ddac2354793bc05260, user_id=428b7002df8f45ab9c6aa2eb28205951, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:46.627733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563db57-6c9b-45c1-8184-a750b6fcaee9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:46.636612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 538/1083] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:46 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/716bdc59d9eb46398492fdea1759ed7a/roles/8b4126aabc1d44c0931e6e1b17cdec11 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:45:46.722591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 546/1084] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:46 2022] PUT /identity/v3/projects/f2dc58781e7747ddac2354793bc05260/users/428b7002df8f45ab9c6aa2eb28205951/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:45:48.541592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f930db-bcb0-4726-9f97-88f869cd5ff9 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:48.542126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f930db-bcb0-4726-9f97-88f869cd5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:48.542126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f930db-bcb0-4726-9f97-88f869cd5ff9 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:48.543641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 539/1085] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:48.548618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102d95-e072-4280-a161-589f8f15838d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:48.549008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102d95-e072-4280-a161-589f8f15838d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:48.549269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e102d95-e072-4280-a161-589f8f15838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:48.568086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5e102d95-e072-4280-a161-589f8f15838d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:48.569253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5e102d95-e072-4280-a161-589f8f15838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:48.597949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:48.633633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71aaa-230d-48de-9ac7-513e1da7fd93 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:48.633910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71aaa-230d-48de-9ac7-513e1da7fd93 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:48.634146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71aaa-230d-48de-9ac7-513e1da7fd93 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:48.634977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 547/1086] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:48.635631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 540/1087] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:48.640621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:48.640933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:48.641210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:48.659878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:48.661056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:48.726952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 548/1088] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:48.901721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71aaa-230d-48de-9ac7-513e1da7fd93 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:48.947343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.004056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.004805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71aaa-230d-48de-9ac7-513e1da7fd93 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.040717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.041344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.041624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.041895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.052191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:49.057133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:49.058599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:49.059492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 541/1089] 10.222.0.58 () {56 vars in 1120 bytes} [Thu Sep 1 17:45:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:49.064544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.101629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.105106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ba68-aff8-468f-b31b-86357cdc89bf None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.138987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.139619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.139900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.140170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.150681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:45:49.155578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:49.156541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:49.157400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 549/1090] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:49.162674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.163920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8803-43ce-4154-9cfd-4f1a86a73394 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.165466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.200129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.200727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.201006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.201276 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.201937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:49.202236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.203640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.212646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 542/1091] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:49.218256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.263172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e3e6-3dd0-4f3b-b3ee-1bb00302729a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.297095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.297758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.298032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.298325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.299025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:49.299325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.300694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.309855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 550/1092] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:49.315781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.318562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9a249-87f0-4381-9c0e-3ff00f3398b3 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.338936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.358303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.358974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.359247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.359514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.370506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.371979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:49.386356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:49.387424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:49.393597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:49.393597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:49.393597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:49.393597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 543/1093] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:49.393597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.411398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.417055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828229dd-715c-4f42-8a18-427390eee3e0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.455969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.456601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.456878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.457144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] PATH_INFO: `/v3/users/428b7002df8f45ab9c6aa2eb28205951` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.458273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] RBAC: Authorizing `identity:get_user(user_id=428b7002df8f45ab9c6aa2eb28205951)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.462304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.463940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 551/1094] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/users/428b7002df8f45ab9c6aa2eb28205951 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:49.469940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.500750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c1fe-04c9-4434-8d6a-bea0da767cee None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.535697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.536296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.536623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.536890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.537523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:49.537819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.539215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.550191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 544/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:49.556578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.562177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.574387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd53f-18ef-4853-abdd-a9f80693f756 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.608383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.608985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.609293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.609565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.633556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.656111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773b09b-7794-4561-985f-1e30d8571c9f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.675883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.677998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.689579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.690196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.690468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.690745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.699027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.700453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:45:49.711479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:49.712623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:45:49.713879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 545/1096] 10.222.0.58 () {56 vars in 1093 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:49.718333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.770049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.785785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 552/1097] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:49.791379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.842076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2c23b-9617-4664-8f0b-3ba054fdd10a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.878591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.879373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.879749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.880121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.880960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:49.881269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.882714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.885260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:49.901871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 546/1098] 10.222.0.58 () {56 vars in 1133 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:49.903691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd3d83-6eb2-4db6-b165-b88f2cc2b96f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:49.907589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:49.938564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:49.939150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:49.939426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:49.939694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:49.940803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:49.942229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:49.945023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 553/1099] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:49.950892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.006285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:50.008350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d5e3-1a39-4a59-8e1e-5e140334b826 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.042410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.043042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.043319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.043587 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.048673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be79c3-8dac-4e16-a865-3505fcfe9324 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.084158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.084938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.085215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.085484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.086202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=f2dc58781e7747ddac2354793bc05260, user.id=428b7002df8f45ab9c6aa2eb28205951) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:50.086507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.087972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.093558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 554/1100] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/role_assignments?user.id=428b7002df8f45ab9c6aa2eb28205951&scope.project.id=f2dc58781e7747ddac2354793bc05260&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:50.108046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:50.116902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.118393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.235011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 547/1101] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:45:50.241494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.342461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b520e2-eb08-4d49-96d6-1a014f8ffa20 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.361270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:50.375360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.375985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.376264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.376525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.387371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.388790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:45:50.402718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:50.403795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:45:50.405112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:45:50.405112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:45:50.405112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:50.405112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 555/1102] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:45:50.409518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.509217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:50.516225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7988-6af3-4928-b6e6-508ed5c9095a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.553073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.553755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.554031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.554297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.554969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:50.555589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.556951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.568591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 548/1103] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:50.574291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.671723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a73-bf79-4254-beaa-bb7663b87c87 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.704869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.705480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.705753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.706016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.712953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.714364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:45:50.725501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:45:50.726633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:45:50.727687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 556/1104] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:45:50.732644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.834387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ff37-ec27-493a-9698-b53d4f68d208 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:50.867104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:50.867695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:50.867967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:50.868233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:50.868910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:50.869206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:50.870627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ee367-ac1b-41c0-b33c-315584edbef0 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:50.883088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 549/1105] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:50.889092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:50.919421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:50.987160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99b463-4864-43d7-a2f8-e0e3fbbce3d3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:51.021244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:51.021834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:51.022109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:51.022372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:51.023112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] RBAC: Adding query filter params (role.id=8b4126aabc1d44c0931e6e1b17cdec11, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=716bdc59d9eb46398492fdea1759ed7a) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:51.023412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:51.024818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7b85-1508-4985-8a8e-06f5f98cac9b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:51.030501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 557/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:50 2022] GET /identity/v3/role_assignments?user.id=716bdc59d9eb46398492fdea1759ed7a&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=8b4126aabc1d44c0931e6e1b17cdec11 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:52.060519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec87f3-2d49-47f2-9f95-e588d7d30d3c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:52.061029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec87f3-2d49-47f2-9f95-e588d7d30d3c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:52.061173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec87f3-2d49-47f2-9f95-e588d7d30d3c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:52.062519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 550/1107] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:52.067547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:52.068589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:52.068778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:52.086987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:52.088154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:52.151533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 558/1108] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:52.424618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec87f3-2d49-47f2-9f95-e588d7d30d3c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:52.441208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:52.531065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec87f3-2d49-47f2-9f95-e588d7d30d3c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:52.565418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:52.566029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:52.566305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:52.566571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:52.567696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:52.570061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e0a85-33f7-4b61-89ec-ff3c8477ebab None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:52.571632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 551/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:52.577519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:52.603522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:52.673525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4c3bb-0015-4e14-bae5-2b8bdfe92b09 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:52.707496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:52.708030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:52.708325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:52.708758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:52.709498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:52.710934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076bf9-aa75-4859-8e96-055b7790804e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:52.806073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 559/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:45:52 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:45:54.753932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53a99-6961-4179-8292-920503b1e932 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:54.754466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53a99-6961-4179-8292-920503b1e932 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:54.754466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53a99-6961-4179-8292-920503b1e932 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:54.756055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 552/1111] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:54.765563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:54.765563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:54.765563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:54.780369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:54.781537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:54.848286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 560/1112] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:55.134327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53a99-6961-4179-8292-920503b1e932 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:55.217279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:55.235730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53a99-6961-4179-8292-920503b1e932 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:55.269927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:55.270541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:55.271484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:55.272157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] PATH_INFO: `/v3/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:55.273555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] RBAC: Authorizing `identity:get_role(role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:55.274946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:55.276256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 553/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:55 2022] GET /identity/v3/roles/af51edba370344dcadca2bd3e932b609 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:55.282065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:55.295903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:55.378043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222af994-5aee-424e-8a6a-56b40c62046c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:55.412123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:55.412720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:55.412961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:55.413233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] PATH_INFO: `/v3/users/d56901e3c92d4221b217e28fb00c5b3f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:55.426049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] RBAC: Authorizing `identity:get_user(user_id=d56901e3c92d4221b217e28fb00c5b3f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:55.428504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:55.430119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 561/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:55 2022] GET /identity/v3/users/d56901e3c92d4221b217e28fb00c5b3f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:55.437947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:55.537806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164961b-98bc-4660-a32b-29f3d6b9e490 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:55.571791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:55.572386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:55.572660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:55.572927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:55.590562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:55.640674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:55.642134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:55.749170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 554/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:45:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:45:55.750222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:55.834953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:55.866631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4192-636c-4819-b32f-31525c13cb83 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:55.901328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:55.901944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:55.902215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:55.902476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:55.903592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:55.904999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcb5f-b4eb-4aaf-8967-9ef1c47ed5f4 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:55.906603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 562/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:45:55 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:45:55.912972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:55.963969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:56.015440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feed65-23ad-4386-b36b-bad654c84f85 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:56.048826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:56.049415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:56.049692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:56.049958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:56.050674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=f2dc58781e7747ddac2354793bc05260, user.id=d56901e3c92d4221b217e28fb00c5b3f) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:45:56.051007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:56.052911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f65ddc-52a2-47cd-a550-db310e1bbdab None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:56.059579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 555/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:45:55 2022] GET /identity/v3/role_assignments?user.id=d56901e3c92d4221b217e28fb00c5b3f&scope.project.id=f2dc58781e7747ddac2354793bc05260&role.id=af51edba370344dcadca2bd3e932b609 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:57.971514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460dd9-eacf-48e5-a222-30805fe323a1 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:57.971977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460dd9-eacf-48e5-a222-30805fe323a1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:57.972094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460dd9-eacf-48e5-a222-30805fe323a1 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:57.973391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 563/1118] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:45:57.979237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:57.979671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:57.979766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:57.998162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:45:57.999369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:45:58.064148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 556/1119] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:45:58.337283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6460dd9-eacf-48e5-a222-30805fe323a1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:58.463432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6460dd9-eacf-48e5-a222-30805fe323a1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:58.470976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:58.471610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:58.471911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:58.472177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] PATH_INFO: `/v3/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:58.473561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] RBAC: Authorizing `identity:get_role(role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:58.475573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:58.476883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 564/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:58 2022] GET /identity/v3/roles/af51edba370344dcadca2bd3e932b609 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:58.483655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:58.533064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:58.586042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ccba8-d131-4d26-b3d3-4fa4d52dc170 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:58.619361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:58.619926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:58.620205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:58.620478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] PATH_INFO: `/v3/users/d56901e3c92d4221b217e28fb00c5b3f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:58.621599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d56901e3c92d4221b217e28fb00c5b3f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:58.623059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:58.624648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 557/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:45:58 2022] GET /identity/v3/users/d56901e3c92d4221b217e28fb00c5b3f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:58.630532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:58.639226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:58.727856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca7d4-3bcb-4a0f-80c5-82c446b98023 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:58.760577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:58.761197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:58.761477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:58.761747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:58.762875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:58.765881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2567c6-e7bd-4365-b911-039f275b122d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:58.765881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 565/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:45:58 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:45:58.772849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:45:58.870564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263906c-cf80-4d60-9843-b172bc2037f9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:45:58.883934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:45:58.904467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:45:58.905236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:45:58.905515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:45:58.905785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260/users/d56901e3c92d4221b217e28fb00c5b3f/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:45:58.907907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2dc58781e7747ddac2354793bc05260, user_id=d56901e3c92d4221b217e28fb00c5b3f, role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:45:58.909415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776fc1-eb55-4941-9f86-eb16ccada361 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:45:58.978806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 558/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:45:58 2022] PUT /identity/v3/projects/f2dc58781e7747ddac2354793bc05260/users/d56901e3c92d4221b217e28fb00c5b3f/roles/af51edba370344dcadca2bd3e932b609 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:46:00.913723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe640a6-7b2f-4d82-9f05-295854f239b0 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:00.914285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe640a6-7b2f-4d82-9f05-295854f239b0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:00.914285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe640a6-7b2f-4d82-9f05-295854f239b0 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:00.915633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 566/1124] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:00.920885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:00.921285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:00.921452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:00.940062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:00.941232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:01.007736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 559/1125] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:01.282364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe640a6-7b2f-4d82-9f05-295854f239b0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:01.356825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:01.380501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe640a6-7b2f-4d82-9f05-295854f239b0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:01.413878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:01.414492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:01.414793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:01.415062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] PATH_INFO: `/v3/roles/af51edba370344dcadca2bd3e932b609` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:01.416418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] RBAC: Authorizing `identity:get_role(role_id=af51edba370344dcadca2bd3e932b609)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:01.417765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:01.419105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 567/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:01 2022] GET /identity/v3/roles/af51edba370344dcadca2bd3e932b609 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:01.424939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:01.524394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a9875-7896-4bca-bd92-64798844aff5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:01.525907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:01.558707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:01.559300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:01.559576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:01.559845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] PATH_INFO: `/v3/users/d56901e3c92d4221b217e28fb00c5b3f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:01.561216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] RBAC: Authorizing `identity:get_user(user_id=d56901e3c92d4221b217e28fb00c5b3f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:01.562645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:01.564244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 560/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:01 2022] GET /identity/v3/users/d56901e3c92d4221b217e28fb00c5b3f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:01.570089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:01.665991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a32e1-97ea-4c2d-9afb-f50d596f10d6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:01.698324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:01.698938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:01.699216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:01.699484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:01.711406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:01.764590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:01.766007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:01.860443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 568/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:01.866344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:01.964804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff086-a991-406d-8db1-e587fa2157ac None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:01.999394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:02.000010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:02.000286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:02.000555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] PATH_INFO: `/v3/projects/f2dc58781e7747ddac2354793bc05260` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:02.001651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f2dc58781e7747ddac2354793bc05260)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:02.003105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955034d9-6483-492c-93d6-9df73c4179f2 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:02.004719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 561/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:01 2022] GET /identity/v3/projects/f2dc58781e7747ddac2354793bc05260 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:02.011569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:02.054738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:02.109719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370c865-fbeb-42d2-b6e4-24640e4af8c0 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:02.143723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:02.144257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:02.144530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:02.144796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:02.145511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] RBAC: Adding query filter params (role.id=af51edba370344dcadca2bd3e932b609, scope.project.id=f2dc58781e7747ddac2354793bc05260, user.id=d56901e3c92d4221b217e28fb00c5b3f) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:02.146289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:02.147744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0ec8d-2554-4911-8227-d7c05c8c87be None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:02.153237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 569/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:46:02 2022] GET /identity/v3/role_assignments?user.id=d56901e3c92d4221b217e28fb00c5b3f&scope.project.id=f2dc58781e7747ddac2354793bc05260&role.id=af51edba370344dcadca2bd3e932b609 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:04.085162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602801-e881-43dc-a67c-557a9750dce6 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:04.085671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602801-e881-43dc-a67c-557a9750dce6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:04.085757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae602801-e881-43dc-a67c-557a9750dce6 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:04.087084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 562/1131] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:04.092186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:04.092612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:04.092705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:04.110422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:04.111632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:04.174658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 570/1132] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:04.445101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602801-e881-43dc-a67c-557a9750dce6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:04.484515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:04.543001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae602801-e881-43dc-a67c-557a9750dce6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:04.576259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:04.576871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:04.577146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:04.577412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:04.578498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:04.579950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb3cd-bece-49cf-b2fd-2d2c7cbba549 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:04.581484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 563/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:04.587465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:04.621038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:04.682480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10171-b7cc-45e7-9070-4089b2342967 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:04.715022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:04.715557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:04.715836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:04.716103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:04.716732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:04.718139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de09af5-2a6c-4613-8265-d9739b9c9dcb None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:04.816835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 571/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:46:04 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:46:06.767191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd1f9-71ac-419f-be3a-25b3eea583f2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:06.767729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd1f9-71ac-419f-be3a-25b3eea583f2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:06.767729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd1f9-71ac-419f-be3a-25b3eea583f2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:06.769070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 564/1135] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:06.775237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:06.775672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:06.775775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:06.794136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:06.795348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:06.859688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 572/1136] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:07.127509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd1f9-71ac-419f-be3a-25b3eea583f2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:07.228582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd1f9-71ac-419f-be3a-25b3eea583f2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:07.235646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:07.261455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:07.262069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:07.262349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:07.262621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:07.263761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:07.265193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0ecc-c1eb-4295-a9b4-85216dd9479d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:07.267020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 565/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:46:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:07.273284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:07.290952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:07.368103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe329c12-9e6c-4e34-ac82-d689552d5ca3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:07.400435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:07.400963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:07.401236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:07.401499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:07.402138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:07.403569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400a01f-94b2-4654-8c3e-922542f6ac0a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:07.507234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 573/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:46:07 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:46:09.478575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc3e4-2bfd-4ab1-b65e-daa250ace364 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:09.479274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc3e4-2bfd-4ab1-b65e-daa250ace364 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:09.479274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc3e4-2bfd-4ab1-b65e-daa250ace364 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:09.480489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 566/1139] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:09.485551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:09.485958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:09.486100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:09.504314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:09.505615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:09.569690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 574/1140] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:09.849978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc3e4-2bfd-4ab1-b65e-daa250ace364 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:09.952009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc3e4-2bfd-4ab1-b65e-daa250ace364 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:09.985979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:09.986590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:09.986907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:09.987178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:09.997871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:10.002639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:10.003685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:10.004632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 567/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:10.009750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:10.012815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:10.109434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc96844-6e95-4dae-9f95-8f6cb8660f1f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:10.142956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:10.143547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:10.143822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:10.144087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:10.144769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:10.145067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:10.146908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:10.154590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 575/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:10.160397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:10.196405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:10.261174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8d2d-4785-44ec-879f-c7bb922d9a78 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:10.294765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:10.295375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:10.295651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:10.295921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] PATH_INFO: `/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:10.309013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] RBAC: Authorizing `identity:get_user(user_id=2a67a7d9c6c74d5dbec630d3a9fdc48b)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:10.310700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:10.312291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 568/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:10 2022] GET /identity/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:10.318697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:10.381747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:10.414356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f1baa-4baa-4b4f-9362-6b728804d562 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:10.447146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:10.447734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:10.448005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:10.448266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:10.511335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:10.512754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:10.572918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:10.607349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 576/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:10.613197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:10.703723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:10.712935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd537-b995-440d-acb9-d3e7b39ee642 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:10.746671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:10.747482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:10.748098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:10.748371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] PATH_INFO: `/v3/projects/133321f422694ee7878b7922e5b3f8a1` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:10.749501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] RBAC: Authorizing `identity:get_project(project_id=133321f422694ee7878b7922e5b3f8a1)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:10.750963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d97ea-04dc-4390-bd12-3d708dc4d75a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:10.752581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 569/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:10 2022] GET /identity/v3/projects/133321f422694ee7878b7922e5b3f8a1 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:10.759374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:10.856285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c55c6-8faf-4eee-aff6-d678323d3822 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:10.894059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:10.894659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:10.894965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:10.895234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:10.896546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=133321f422694ee7878b7922e5b3f8a1, user.id=2a67a7d9c6c74d5dbec630d3a9fdc48b) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:10.896848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:10.898252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf5eb-ef88-4f3d-bc62-10b7158af4bf None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:10.903521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 577/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:46:10 2022] GET /identity/v3/role_assignments?user.id=2a67a7d9c6c74d5dbec630d3a9fdc48b&scope.project.id=133321f422694ee7878b7922e5b3f8a1&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:12.825551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b035c-495f-4127-8ce5-425995aaaf6e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:12.826127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b035c-495f-4127-8ce5-425995aaaf6e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:12.826127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b035c-495f-4127-8ce5-425995aaaf6e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:12.827473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 570/1147] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:12.832655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:12.833179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:12.833280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:12.850937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:12.852115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:12.875298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:12.919437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 578/1148] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:13.191259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b035c-495f-4127-8ce5-425995aaaf6e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:13.289243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b035c-495f-4127-8ce5-425995aaaf6e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:13.322159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:13.322793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:13.323073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:13.323342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:13.333541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:13.338338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:13.339471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:13.340488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 571/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:13.345328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:13.441093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca806e8-0a43-49b3-8393-4d7666621664 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:13.474635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:13.475182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:13.475455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:13.475716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:13.476357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:13.476650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:13.477983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:13.485613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 579/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:13.491488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:13.514293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:13.590632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ce55-02c0-44b9-be66-8b7474b98c50 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:13.623928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:13.624539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:13.624819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:13.625092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] PATH_INFO: `/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:13.626207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] RBAC: Authorizing `identity:get_user(user_id=2a67a7d9c6c74d5dbec630d3a9fdc48b)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:13.627665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:13.629231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 572/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:13 2022] GET /identity/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:13.634992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:13.659599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:13.735005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aeb48-67f5-45f3-93d6-7f07703a257f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:13.767509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:13.768127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:13.768399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:13.768714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] PATH_INFO: `/v3/projects/133321f422694ee7878b7922e5b3f8a1` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:13.769795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] RBAC: Authorizing `identity:get_project(project_id=133321f422694ee7878b7922e5b3f8a1)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:13.771981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9bb53-0e17-46d7-afb6-5f78c35ef57b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:13.773629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 580/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:13 2022] GET /identity/v3/projects/133321f422694ee7878b7922e5b3f8a1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:13.779684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:13.864894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:13.876221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52262a3-32a8-4d06-8e56-3dfd4e5df281 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:13.909291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:13.909928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:13.910200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:13.910469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] PATH_INFO: `/v3/projects/133321f422694ee7878b7922e5b3f8a1/users/2a67a7d9c6c74d5dbec630d3a9fdc48b/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:13.912500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=133321f422694ee7878b7922e5b3f8a1, user_id=2a67a7d9c6c74d5dbec630d3a9fdc48b, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:13.913908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35898e-39e7-4597-b2ef-fcd7f06c09d7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:14.004291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 573/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:46:13 2022] PUT /identity/v3/projects/133321f422694ee7878b7922e5b3f8a1/users/2a67a7d9c6c74d5dbec630d3a9fdc48b/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:46:15.911588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566098-24aa-497f-9631-28f1a9cf0e66 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:15.912121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566098-24aa-497f-9631-28f1a9cf0e66 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:15.912121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566098-24aa-497f-9631-28f1a9cf0e66 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:15.913432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 581/1154] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:15.918438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:15.918890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:15.919016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:15.937926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:15.939138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:16.004344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 574/1155] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:16.277777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566098-24aa-497f-9631-28f1a9cf0e66 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:16.367435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:16.377408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566098-24aa-497f-9631-28f1a9cf0e66 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:16.410286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:16.411017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:16.411296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:16.411565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:16.421324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:16.426183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:16.427749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:46:16.428660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 582/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:16.433766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:16.511829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:16.532168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0a6b-3000-48ef-9f2e-ba30a4d8dba0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:16.565421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:16.566015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:16.566480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:16.566832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:16.568259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:16.568983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:16.570361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:16.578216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 575/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:16.584348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:16.686703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b81a7-d713-49b1-ab7e-2c98bd6eacaf None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:16.720315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:16.720938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:16.721219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:16.721492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] PATH_INFO: `/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:16.722607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] RBAC: Authorizing `identity:get_user(user_id=2a67a7d9c6c74d5dbec630d3a9fdc48b)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:16.724581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:16.726149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 583/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:16 2022] GET /identity/v3/users/2a67a7d9c6c74d5dbec630d3a9fdc48b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:16.732132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:16.831232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fe6d1-6794-4161-bb55-3361b9835448 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:16.864557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:16.865158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:16.865457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:16.865721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:16.875972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:16.933485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:16.934995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:17.030662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 576/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:17.037211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:17.055999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:17.134354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4500443-c3f3-4510-b02a-3e3957f83e71 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:17.167500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:17.168109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:17.168385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:17.168655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] PATH_INFO: `/v3/projects/133321f422694ee7878b7922e5b3f8a1` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:17.169757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] RBAC: Authorizing `identity:get_project(project_id=133321f422694ee7878b7922e5b3f8a1)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:17.171199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfafc74-fbac-4e2c-aca9-de0cdc870d24 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:17.172839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 584/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:17 2022] GET /identity/v3/projects/133321f422694ee7878b7922e5b3f8a1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:17.178979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:17.218795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:17.274451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca2e0-3e2b-4401-bdaf-67ac3e055a73 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:17.307035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:17.307620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:17.307895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:17.308162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:17.308873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=133321f422694ee7878b7922e5b3f8a1, user.id=2a67a7d9c6c74d5dbec630d3a9fdc48b) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:17.309173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:17.310883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82106d90-aa88-4188-8700-3da887afc199 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:17.316337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 577/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:46:17 2022] GET /identity/v3/role_assignments?user.id=2a67a7d9c6c74d5dbec630d3a9fdc48b&scope.project.id=133321f422694ee7878b7922e5b3f8a1&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:19.269057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac76b-7519-41ee-9ec7-ee1ca7afd76d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:19.269576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac76b-7519-41ee-9ec7-ee1ca7afd76d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:19.269576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac76b-7519-41ee-9ec7-ee1ca7afd76d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:19.271226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 585/1162] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:19.276496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:19.276909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:19.277048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:19.295547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:19.296735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:19.362666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 578/1163] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:19.629640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aac76b-7519-41ee-9ec7-ee1ca7afd76d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:19.714249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:19.733774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aac76b-7519-41ee-9ec7-ee1ca7afd76d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:19.775559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:19.776167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:19.776449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:19.776721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:19.842995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:19.844425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:19.923232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:19.938150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 586/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:19.944532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:19.977473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:20.042994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7b76b-7c5e-4fa8-a676-380a31c21d06 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:20.076285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:20.076896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:20.077172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:20.077437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:20.084565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:20.085994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-87daa00c-7e9f-4b8f-8d24-97b61dde2d28 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:20.097033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:20.098304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:20.099293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 579/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:46:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:20.104118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:20.202955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecf0cc-b4bc-43f2-b5ad-7608354a806f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:20.235659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:20.236243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:20.236514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:20.236777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:20.237402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:20.237694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:20.239076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f3eee-6618-4660-a10f-c7292c8b4dfe None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:20.245999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 587/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Thu Sep 1 17:46:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:22.178428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffb46-8135-400f-b56d-257ed5263181 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:22.178428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffb46-8135-400f-b56d-257ed5263181 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:22.179144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffb46-8135-400f-b56d-257ed5263181 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:22.179957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 580/1167] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:22.185851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaeac6-8c4e-48d2-bde3-b9787e83cd1b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:22.186290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaeac6-8c4e-48d2-bde3-b9787e83cd1b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:22.186392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaeac6-8c4e-48d2-bde3-b9787e83cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:22.205238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-36eaeac6-8c4e-48d2-bde3-b9787e83cd1b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:22.206428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-36eaeac6-8c4e-48d2-bde3-b9787e83cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:22.251756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:22.272535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 588/1168] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:22.536921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffb46-8135-400f-b56d-257ed5263181 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:22.630261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:22.637518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffb46-8135-400f-b56d-257ed5263181 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:22.669467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:22.670051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:22.670324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:22.670587 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:22.671275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:22.672640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99a884-442e-4f30-a62a-9c585a6457c4 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:22.796615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 581/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Thu Sep 1 17:46:22 2022] POST /identity/v3/domains => generated 267 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:46:24.746210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d026-1a70-44ea-bbf9-ac3b8c1a2521 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:24.746802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d026-1a70-44ea-bbf9-ac3b8c1a2521 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:24.746802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d026-1a70-44ea-bbf9-ac3b8c1a2521 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:24.748139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 589/1170] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:24.753184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c19-6196-4705-9e09-44436945c10c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:24.753567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c19-6196-4705-9e09-44436945c10c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:24.753729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c19-6196-4705-9e09-44436945c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:24.773182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b0233c19-6196-4705-9e09-44436945c10c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:24.774351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b0233c19-6196-4705-9e09-44436945c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:24.839525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 582/1171] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:25.105453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d026-1a70-44ea-bbf9-ac3b8c1a2521 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:25.204011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d026-1a70-44ea-bbf9-ac3b8c1a2521 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:25.237096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:25.237753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:25.238034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:25.238306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] PATH_INFO: `/v3/domains/abd5cd08edf84ad9a5f4f18481a9a5b5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:25.249118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=abd5cd08edf84ad9a5f4f18481a9a5b5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:25.250553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df9b4-23dc-40a3-98d6-48922e220a0c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:25.252196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 590/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Sep 1 17:46:25 2022] GET /identity/v3/domains/abd5cd08edf84ad9a5f4f18481a9a5b5 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:25.258844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0233c19-6196-4705-9e09-44436945c10c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:25.344030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:25.358949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0233c19-6196-4705-9e09-44436945c10c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:25.392960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:25.393559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:25.393835 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:25.394105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:25.394765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:25.396226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf9dc-3ddd-428b-962e-7350929a2eb8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:25.519039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 583/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:46:25 2022] POST /identity/v3/projects => generated 361 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:46:27.499922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b7fa-5ecc-4c70-a188-ffb25c1be1c5 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:27.500481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b7fa-5ecc-4c70-a188-ffb25c1be1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:27.500481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b7fa-5ecc-4c70-a188-ffb25c1be1c5 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:27.501803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 591/1174] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:27.508764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:27.509149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:27.509320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:27.528267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:27.529446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:27.596178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 584/1175] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:27.877446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180b7fa-5ecc-4c70-a188-ffb25c1be1c5 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:27.920598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:27.979595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180b7fa-5ecc-4c70-a188-ffb25c1be1c5 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:28.012934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:28.013554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:28.013831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:28.014100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] PATH_INFO: `/v3/domains/abd5cd08edf84ad9a5f4f18481a9a5b5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:28.015228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=abd5cd08edf84ad9a5f4f18481a9a5b5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:28.016642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3041ece-279e-4718-913c-718dd3a8c621 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:28.018186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 592/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Thu Sep 1 17:46:27 2022] GET /identity/v3/domains/abd5cd08edf84ad9a5f4f18481a9a5b5 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:28.024389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:28.089727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:28.123440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4d4a-8093-418a-bf62-6337f386e4e4 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:28.156518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:28.157114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:28.157386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:28.157651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:28.158296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:28.159866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc00e-cb78-446b-9a6f-4d62f8eb76ef None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:28.318028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 585/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:46:28 2022] POST /identity/v3/users => generated 311 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:46:30.261681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eb99-d738-411e-a8fe-22ff2926d0f0 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:30.262213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eb99-d738-411e-a8fe-22ff2926d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:30.262213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75eb99-d738-411e-a8fe-22ff2926d0f0 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:30.263521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 593/1178] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:30.268667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:30.269065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:30.269222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:30.291988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:30.293192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:30.359528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 586/1179] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:30.635515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75eb99-d738-411e-a8fe-22ff2926d0f0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:30.743076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75eb99-d738-411e-a8fe-22ff2926d0f0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:30.753044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:30.787804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:30.788465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:30.789118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:30.789782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:30.800427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:30.809130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:30.810567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:46:30.811710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 594/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:30.813809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:30.865977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:30.912382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7c111-7c97-4117-9058-f948fcb0c10f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:30.947518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:30.948121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:30.948398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:30.948667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:30.949329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:30.949631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:30.951032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:30.960007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 587/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:30.965236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:31.064636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49644-c09c-4053-b4f9-4a8f76f2e966 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:31.106621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:31.107273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:31.107554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:31.107825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] PATH_INFO: `/v3/users/00d57f0718da42f095d7d8d386ff8fad` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:31.121318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] RBAC: Authorizing `identity:get_user(user_id=00d57f0718da42f095d7d8d386ff8fad)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:31.122772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:31.124381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 595/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:30 2022] GET /identity/v3/users/00d57f0718da42f095d7d8d386ff8fad => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:31.130353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:31.229156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1d2b-3a54-4e2a-b584-2e669f8fe60a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:31.242832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:31.261926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:31.262514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:31.262823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:31.263115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:31.328073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:31.329508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:31.425326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 588/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:31.431351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:31.460172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:31.528966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eb38c-4089-40ea-a3b8-d6e8bffd38da None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:31.562794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:31.563414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:31.563694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:31.563971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] PATH_INFO: `/v3/projects/c1d626d621c8436e9a2231a6e9435226` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:31.565083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] RBAC: Authorizing `identity:get_project(project_id=c1d626d621c8436e9a2231a6e9435226)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:31.566504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5fe68-10a3-4cdc-9d98-f58ef5beaadc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:31.568265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 596/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:31 2022] GET /identity/v3/projects/c1d626d621c8436e9a2231a6e9435226 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:31.574390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:31.589980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:31.671992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2d0c7-6519-4701-8f53-7e07047e79c9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:31.704482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:31.705069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:31.705346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:31.705616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:31.706327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=c1d626d621c8436e9a2231a6e9435226, user.id=00d57f0718da42f095d7d8d386ff8fad) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:31.706632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:31.708776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccae28e-82f3-49db-8052-9bb5250a0faa None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:31.713941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 589/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:46:31 2022] GET /identity/v3/role_assignments?user.id=00d57f0718da42f095d7d8d386ff8fad&scope.project.id=c1d626d621c8436e9a2231a6e9435226&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:33.647762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65ecc-7478-47af-9e8e-2d83782afcba None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:33.648317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65ecc-7478-47af-9e8e-2d83782afcba None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:33.648317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65ecc-7478-47af-9e8e-2d83782afcba None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:33.649656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 597/1186] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:33.654735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:33.655117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:33.655320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:33.673612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:33.674812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:33.739709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 590/1187] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:34.013404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65ecc-7478-47af-9e8e-2d83782afcba None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:34.106456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.113620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65ecc-7478-47af-9e8e-2d83782afcba None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:34.147834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:34.148451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:34.148757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:34.149028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:34.158828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:34.163806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:34.164918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:46:34.166000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 598/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:34.170983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:34.181058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.268282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224c0c-70fe-408a-ace4-cf36b822b5ee None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:34.301884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:34.302475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:34.302778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:34.303056 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:34.303715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:34.304018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:34.305389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:34.313441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 591/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:34.319671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:34.423940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb61f64-c106-416a-a4ee-d4e4508788f8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:34.457031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:34.457826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:34.458100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:34.458368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] PATH_INFO: `/v3/users/00d57f0718da42f095d7d8d386ff8fad` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:34.459498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] RBAC: Authorizing `identity:get_user(user_id=00d57f0718da42f095d7d8d386ff8fad)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:34.460917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:34.462462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 599/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:34 2022] GET /identity/v3/users/00d57f0718da42f095d7d8d386ff8fad => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:34.468239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:34.536631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.570354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584bd-d7a2-4bf4-9b93-215ee53a9d01 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:34.606801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:34.607424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:34.607704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:34.607976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] PATH_INFO: `/v3/projects/c1d626d621c8436e9a2231a6e9435226` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:34.609128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d626d621c8436e9a2231a6e9435226)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:34.610616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4528e0-b705-431a-9a1d-9051bf32bbf8 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:34.612347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 592/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:34 2022] GET /identity/v3/projects/c1d626d621c8436e9a2231a6e9435226 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:34.618830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:34.646597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.720243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af84e2-2df9-442e-9638-717a33361326 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:34.753591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:34.754347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:34.754602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:34.755026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] PATH_INFO: `/v3/projects/c1d626d621c8436e9a2231a6e9435226/users/00d57f0718da42f095d7d8d386ff8fad/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:34.756909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] RBAC: Authorizing `identity:create_grant(project_id=c1d626d621c8436e9a2231a6e9435226, user_id=00d57f0718da42f095d7d8d386ff8fad, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:34.758313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dd214-c66e-4c1e-8ba0-18807c8b379f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:34.835247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 600/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:46:34 2022] PUT /identity/v3/projects/c1d626d621c8436e9a2231a6e9435226/users/00d57f0718da42f095d7d8d386ff8fad/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:46:36.737577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e305f-517e-4284-8ff8-cbbbee9bc8b2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:36.738138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e305f-517e-4284-8ff8-cbbbee9bc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:36.738138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e305f-517e-4284-8ff8-cbbbee9bc8b2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:36.739614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 593/1193] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:46:36.744796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:36.745174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:36.745344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:36.763204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:46:36.764392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:46:36.830300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 601/1194] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:46:37.100688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e305f-517e-4284-8ff8-cbbbee9bc8b2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:37.201087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e305f-517e-4284-8ff8-cbbbee9bc8b2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:37.234301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:37.234940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:37.235222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:37.235497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:37.242129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:37.245848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:46:37.250685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:46:37.251836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:46:37.253077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 594/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:46:37.258587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:37.273196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:37.356273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddc22-c2ff-410f-8db9-fce97ff5d33f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:37.390104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:37.390691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:37.390998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:37.391264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:37.391909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:37.392204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:37.393552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:37.401917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 602/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:37.407771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:37.505958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003037ec-b2db-42b1-8515-d91a1daf4375 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:37.538619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:37.539254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:37.539528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:37.539792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] PATH_INFO: `/v3/users/00d57f0718da42f095d7d8d386ff8fad` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:37.540894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] RBAC: Authorizing `identity:get_user(user_id=00d57f0718da42f095d7d8d386ff8fad)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:37.542313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:37.543892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 595/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/users/00d57f0718da42f095d7d8d386ff8fad => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:37.549759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:37.622664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:37.646500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6d87-0e96-4808-b89d-e505db2f66b2 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:37.679119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:37.679723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:37.680000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:37.680270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:37.746243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:37.747723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:37.819098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:37.843124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 603/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:46:37.849807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:37.914291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:37.947551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b77-2ba3-4ece-8e6b-3b26a1f8bdcd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:37.984437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:37.985058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:37.985338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:37.985611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] PATH_INFO: `/v3/projects/c1d626d621c8436e9a2231a6e9435226` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:37.986753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d626d621c8436e9a2231a6e9435226)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:37.988205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762478c9-65fd-412d-8de3-f356d98dc877 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:37.989905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 596/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/projects/c1d626d621c8436e9a2231a6e9435226 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:37.996114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:46:38.093541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c692d-89af-4d5f-93d5-599b1012e934 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:46:38.126254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:46:38.126877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:46:38.127154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:46:38.127423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:46:38.128131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=c1d626d621c8436e9a2231a6e9435226, user.id=00d57f0718da42f095d7d8d386ff8fad) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:46:38.128431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:46:38.130425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368f15f-606d-4551-8d07-3f5de44a38bc None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:46:38.135957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 604/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:46:37 2022] GET /identity/v3/role_assignments?user.id=00d57f0718da42f095d7d8d386ff8fad&scope.project.id=c1d626d621c8436e9a2231a6e9435226&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:46:47.978956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=33 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:48.133413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=81 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:53.980964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2312f-533d-4797-9385-96e7d414e4ad None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:53.981526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2312f-533d-4797-9385-96e7d414e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:53.981526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2312f-533d-4797-9385-96e7d414e4ad None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:53.982876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 597/1201] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:47:53.988250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:53.988705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:53.988808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:54.007818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:47:54.009004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:47:54.075178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 605/1202] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:47:54.344164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2312f-533d-4797-9385-96e7d414e4ad None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:54.446106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2312f-533d-4797-9385-96e7d414e4ad None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:54.480218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:54.480831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:54.481104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:54.481372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:54.491913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:54.493360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:47:54.508191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:54.509397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:47:54.510402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:47:54.510402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:54.510402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:47:54.510402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 598/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:54.515410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:54.615774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc87b4-274d-4561-b4bc-4f72d19ad583 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:54.645047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:54.651779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:54.652384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:54.652662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:54.652933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:54.653572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:54.653874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:54.655285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9242ce-18f8-497e-bb58-da804970f5dd None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:54.667457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 606/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:54.673323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:54.726595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:54.771696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093ea6-025d-4753-a762-be2eb03081a9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:54.804062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:54.804651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:54.804925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:54.805192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:54.805836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:54.807282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabec65d-d4ea-4287-839f-c0687782a430 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:54.900685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 599/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Thu Sep 1 17:47:54 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:47:56.860765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbccc7-b267-4e89-81d8-15aab524b7a1 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:56.861343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbccc7-b267-4e89-81d8-15aab524b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:56.861343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbccc7-b267-4e89-81d8-15aab524b7a1 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:56.862816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 607/1206] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:47:56.868429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70796-8125-4f07-af1e-852525d75dac None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:56.868863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70796-8125-4f07-af1e-852525d75dac None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:56.868965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e70796-8125-4f07-af1e-852525d75dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:56.887553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-28e70796-8125-4f07-af1e-852525d75dac None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:47:56.893375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-28e70796-8125-4f07-af1e-852525d75dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:47:56.978264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 600/1207] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:47:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:47:57.250663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbccc7-b267-4e89-81d8-15aab524b7a1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:57.350269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbccc7-b267-4e89-81d8-15aab524b7a1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:57.384051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:57.384680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:57.384959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:57.385229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:57.395084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:47:57.400064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:57.401200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:47:57.402328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:47:57.406187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 608/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:57.407356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e70796-8125-4f07-af1e-852525d75dac None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:57.446583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:57.504520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e70796-8125-4f07-af1e-852525d75dac None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:57.537699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:57.538288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:57.538559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:57.538854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:57.539509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:57.539806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:57.541167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:57.548739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 601/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:57.554763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:57.605118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:57.654520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a5e9-534c-495e-9b7b-ed1f4fabc40d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:57.688305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:57.688920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:57.689193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:57.689457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:57.699196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:57.700662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:47:57.715266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:57.716523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:47:57.717751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:47:57.717751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:57.717751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:47:57.717751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 609/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:57.722315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:57.820965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:57.824069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d76f7d-7927-415f-81bc-71fd859fb24c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:57.857644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:57.858239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:57.858520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:57.858820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:57.859462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:57.859762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:57.861127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:57.872745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 602/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:57.878299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:57.979157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bee5b-d992-4502-bd35-e573608879a8 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:57.980687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:58.017661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.018280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.018553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.018845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.025687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.027150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:47:58.039618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:58.040933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:47:58.042114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 610/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:58.048187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:58.148833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40613dac-c200-4a88-9e8e-c1c9bf7692fd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:58.181832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.185098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.185098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.185098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.185098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:58.185098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.185528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.202480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 603/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:47:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:58.208346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:58.310436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca00fb-3ecf-4446-a414-3a5b4fe64e93 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:58.344259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.344861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.345138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.345408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.375739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:58.413226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.414646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.514308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 611/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:47:58.520405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:58.540188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:58.621728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa8586-3820-41f6-af7a-30804a12066e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:58.655946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.656563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.656837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.657106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.668850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.668850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:47:58.683179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:58.684294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:47:58.685428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:47:58.685428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:47:58.685428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:47:58.685428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 604/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:58.690471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:58.750129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:58.788317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32a092-cbca-4f64-a178-76c62093361e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:58.821565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.822174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.822455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.822753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.823401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:58.823701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.825090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.837280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 612/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:58.843162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:58.910655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:58.941451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7b21d-939a-4e2a-8fcf-ce357bbbe29c None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:58.978077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:58.978699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:58.979016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:58.979286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:58.985931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:58.987413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:47:58.999562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:47:59.001575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:47:59.002791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 605/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:47:59.007505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:59.107978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517aa1b-8a47-4de2-bfbe-b012d3a26c91 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:59.130059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:59.141787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:59.142381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:59.142657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:59.142952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:59.143629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:59.143929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:59.145333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9cee-d517-4960-b600-0e2ab318f301 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:59.156475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 613/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:47:59.162487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:47:59.264449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96601a-23d2-4249-a17f-9b4f49361ec9 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:47:59.296406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:59.302180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:47:59.303403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:47:59.303685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:47:59.303959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:47:59.304686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=90fb57878f024c05bdc9166eea624e73) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:47:59.304997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:47:59.306429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df24dc-be3b-4cbc-a81f-348b228f8987 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:47:59.312043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 606/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:47:59 2022] GET /identity/v3/role_assignments?user.id=90fb57878f024c05bdc9166eea624e73&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:01.267938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4318-8b39-44cd-8e37-1ee1613bd9ba None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:01.268450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4318-8b39-44cd-8e37-1ee1613bd9ba None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:01.268450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4318-8b39-44cd-8e37-1ee1613bd9ba None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:01.269757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 614/1220] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:48:01.276719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:01.277166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:01.283449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:01.296635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:01.297826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:01.367967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 607/1221] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:01.641239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4318-8b39-44cd-8e37-1ee1613bd9ba None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:01.742074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4318-8b39-44cd-8e37-1ee1613bd9ba None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:01.776106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:01.776721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:01.776993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:01.777258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:01.787496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:48:01.792355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:01.793489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:01.794948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 615/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:01.799547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:01.901123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73477f49-0be1-482e-99c1-7244b9aa4d51 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:01.923750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:01.934454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:01.935116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:01.935379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:01.935643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:01.936557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] RBAC: Adding query filter params (name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:01.936852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:01.938204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:01.946950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 608/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:01.952903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:01.999228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:02.051859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29a65-8992-4f90-9bf5-d2294dad1701 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.085900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.086520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.086825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.087095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.096886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.098298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:02.112417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:02.113592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:02.114713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:02.114713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:02.114713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:02.114713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 616/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:02.120173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.219474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0f8e-c40b-4487-9a29-a17da46ea8df None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.253189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.253786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.254067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.254325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.255013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:02.260533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.260533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.269187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 609/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:02.275203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.369768 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:02.375972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d38984-0727-44b6-b801-31f998dc0fb3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.408962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.409638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.409913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.410178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.417870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.419351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:48:02.431024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:02.442111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:02.443524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 617/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:02.444254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.485498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:02.538270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0f2b0-c14b-4401-b29c-545d62ee00f7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.571169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.571759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.572034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.572300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.573010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:02.573307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.574714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.591507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 610/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:02.597399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.696570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ce72-ad7b-4466-82e2-810a34b26aff None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.729066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.729680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.729957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.730224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.741061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.742419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:02.756157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:02.757275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:02.758499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:02.758499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:02.758499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:02.758499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 618/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:02.763207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.862783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b92-3bb3-4804-b32c-46de53a6cf90 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:02.865271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:02.895356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:02.895953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:02.896786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:02.897059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:02.897687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:02.897986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:02.899389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:02.910176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 611/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:02.916709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:02.925865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:03.016162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a44d7-1abb-403b-ac88-ef5bf93d26b3 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:03.057023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:03.057661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:03.057920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:03.058183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:03.065626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:03.067134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:48:03.078743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:03.084508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:03.085628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 619/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:03.086431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:03.185697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992054-cad7-45ae-b801-ee4774e9bc52 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:03.219821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:03.220415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:03.220691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:03.220962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:03.221647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:03.221950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:03.223416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b19816-6b7f-4e08-8e74-5818a0b1a967 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:03.235382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 612/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:03.241673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:03.308571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:03.345329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466398-f660-4687-8229-3cb88c3c6e36 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:03.382281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:03.383010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:03.383292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:03.383563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/90fb57878f024c05bdc9166eea624e73/roles/423cb470b27d4556a0323c4ad63a0942` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:03.398805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=90fb57878f024c05bdc9166eea624e73, role_id=423cb470b27d4556a0323c4ad63a0942)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:03.400821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba29f1-e638-4891-9e0b-cbe656d33758 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:03.503627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 620/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:48:03 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/90fb57878f024c05bdc9166eea624e73/roles/423cb470b27d4556a0323c4ad63a0942 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:48:05.435014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4060f6-44fd-40cb-affc-986c8bd2631f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:05.435573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4060f6-44fd-40cb-affc-986c8bd2631f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:05.435573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4060f6-44fd-40cb-affc-986c8bd2631f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:05.437142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 613/1233] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:48:05.442377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:05.442800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:05.443000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:05.460583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:05.466404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:05.526683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 621/1234] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:05.797012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4060f6-44fd-40cb-affc-986c8bd2631f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:05.822915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:05.897575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4060f6-44fd-40cb-affc-986c8bd2631f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:05.931205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:05.932304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:05.932304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:05.932462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:05.943195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:48:05.947970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:05.949080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:05.950120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 614/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Thu Sep 1 17:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:05.955462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.002234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:06.053035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486a554-5c72-48a1-8684-40f077873ee6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.085827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.086422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.087398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.087398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.087625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] RBAC: Adding query filter params (name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:06.087923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.089270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:06.096885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 622/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Thu Sep 1 17:48:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:06.103405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.185086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:06.200978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772d301-a7ad-4446-8657-3545d236a153 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.233827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.234440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.234715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.235005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.245506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.246982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:06.261846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:06.262902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:06.263808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:06.263808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:06.263808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:06.263808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 615/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:06.268932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.374004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64623ca4-6333-4108-917e-7c6c28ea9580 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.383695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:06.415695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.416302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.416580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.416915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.417559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:06.417862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.419331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:06.431218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 623/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:06.437669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.539249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9398-6a01-4fec-805f-a017343f48e7 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.572789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.573406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.573678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.573943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.576545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:06.581280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.582773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:48:06.593638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:06.594822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:06.595813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:06.598901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 616/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:06.602983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.700605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6554-5ce7-46b6-84b1-a4c431845d6d None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.734252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.734900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.735183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.735456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.736202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:06.736585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.738045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:06.757444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 624/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:48:06.763408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:06.863836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a894-59f6-41d3-a946-61b103401c39 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:06.899030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:06.899627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:06.899906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:06.900176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:06.962576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:06.969169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:06.970633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.067740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 617/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:48:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:48:07.073965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:07.100947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:07.171016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd112-906e-4f9e-855e-e0468f5f3aba None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:07.204317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:07.204929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:07.205203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:07.205469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:07.215182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:07.216553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:07.231363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:07.232562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:07.233697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:07.233697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:07.233697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:07.233697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 625/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:48:07.238336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:07.332437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:07.338995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472cdb-03eb-4772-8e46-6208cb85db87 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:07.373389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:07.374408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:07.374988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:07.375486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:07.376656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:07.377209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:07.379798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.395444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 618/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:07.402545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:07.487534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:07.507992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94783e-57f2-4f39-9f64-30488393ba0e None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:07.541225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:07.541846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:07.542128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:07.542394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:07.548790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:07.550288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:48:07.561576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:07.562613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:07.563918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 626/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:07.568746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:07.669946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2676-1d20-40ef-a07a-730053579898 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:07.703457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:07.704060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:07.704341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:07.704611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:07.705299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:07.705627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:07.707082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d249b-775b-4572-84a9-16c62959aefa None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.719361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 619/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:07.725701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:07.825867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e443-dad8-43bc-9997-8ba1a092b47a None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:07.858989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:07.859590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:07.859869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:07.860139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:07.860860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] RBAC: Adding query filter params (role.id=423cb470b27d4556a0323c4ad63a0942, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=90fb57878f024c05bdc9166eea624e73) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:07.861164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:07.862575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376cc37-5fca-4a00-a68b-fccf8fa253b9 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:07.868513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 627/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:48:07 2022] GET /identity/v3/role_assignments?user.id=90fb57878f024c05bdc9166eea624e73&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=423cb470b27d4556a0323c4ad63a0942 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:09.861528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815757e3-1be2-4184-8134-8e2d17ed3ac7 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:09.862062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815757e3-1be2-4184-8134-8e2d17ed3ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:09.862062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815757e3-1be2-4184-8134-8e2d17ed3ac7 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:09.863455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 620/1247] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:09.869128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:09.869539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:09.869680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:09.875992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:09.888674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:09.893474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:09.955695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 628/1248] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:10.229843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815757e3-1be2-4184-8134-8e2d17ed3ac7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:10.248610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:10.332405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815757e3-1be2-4184-8134-8e2d17ed3ac7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:10.366552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:10.367199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:10.367475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:10.367746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:10.377605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:48:10.382817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:10.383930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:10.385147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 621/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:10.390093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:10.488560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2cd46-fb95-4eda-a52f-7f36f1dd3402 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:10.517823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:10.522681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:10.523304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:10.523638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:10.523908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:10.524552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:10.524846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:10.526206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:10.533995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 629/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:10.539909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:10.618203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:10.641419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4e35d-090a-41f2-bc5a-a07909a7801e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:10.673811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:10.674417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:10.674691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:10.674989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:10.685236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:10.686950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:10.700974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:10.702807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:10.704578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:10.704578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:10.704578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:10.704578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 622/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:10.707982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:10.808377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c706c11-4ed6-4837-912b-864f63e56311 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:10.841644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:10.842243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:10.842520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:10.842815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:10.843454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:10.843775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:10.845128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:10.857674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 630/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:10.863874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:10.965967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418db8-5b82-4201-b557-ee9731c45923 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:10.992892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:11.000530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.001148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.001426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.001695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.009206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.010644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:48:11.023251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:11.024460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:11.025439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 623/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:11.030452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:11.086796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:11.131807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0493c-e078-4576-b9de-9e110876d859 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:11.166030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.166628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.166935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.167207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.167933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:11.168235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.169648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.186406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 631/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:48:11.192209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:11.294971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110dc6-9532-4baa-97be-c7cc7a3d0e7e None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:11.329358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.329953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.330233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.330503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.386053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:11.398556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.400060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.502149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 624/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:48:11.508742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:11.609246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb33861-ae3b-41c0-9ccc-5aeff713d26f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:11.622198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:11.643003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.643562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.643844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.644112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.654620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.656081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:11.670487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:11.671706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:11.672920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:11.672920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:11.672920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:11.672920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 632/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:11.677683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:11.765398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:11.776869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b8eb-3930-4ccf-924b-e6e50b59624b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:11.812612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.813204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.813478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.813743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.814374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:11.814671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.816050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.827913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 625/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:11.833909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:11.934250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e10bd-b3b3-4be1-93dd-80de4e53f7ea None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:11.969260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:11.969889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:11.970166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:11.970435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:11.977310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:11.978714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:48:11.990375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:11.991519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:11.992640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 633/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:11.997426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:12.101204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77732-858c-46c1-931c-7ab53002933a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:12.136133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:12.136746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:12.137014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:12.137283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:12.137972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:12.138271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:12.139727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d800e-7b51-4935-89c3-0ac8a3202512 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:12.152151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 626/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:12.158310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:12.185049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:12.256871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da049d7e-709e-4f89-9acb-2b80cfbc98ba None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:12.290940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:12.291546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:12.291824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:12.292095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:12.292815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=90fb57878f024c05bdc9166eea624e73) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:12.293126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:12.294554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53238-da58-482d-bf7e-56704fcf824b None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:12.299988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 634/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:48:12 2022] GET /identity/v3/role_assignments?user.id=90fb57878f024c05bdc9166eea624e73&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:14.184171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ed2d-e898-4123-904e-deae31a10e88 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:14.184700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ed2d-e898-4123-904e-deae31a10e88 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:14.184700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ed2d-e898-4123-904e-deae31a10e88 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:14.186327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 627/1261] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:14.191482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:14.191895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:14.192026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:14.211690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:14.212806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:14.278423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 635/1262] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:14.543774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ed2d-e898-4123-904e-deae31a10e88 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:14.554939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:14.644325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ed2d-e898-4123-904e-deae31a10e88 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:14.680134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:14.680757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:14.681038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:14.681303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:14.691537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:48:14.696991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:14.698105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:14.699371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 628/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:14.704160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:14.723777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:14.805850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140565-2df9-475d-97fd-7ce20e6f5f62 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:14.839640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:14.840258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:14.840535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:14.840800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:14.841453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:14.841752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:14.843150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:14.851186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 636/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:14.857195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:14.923484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:14.956708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecbf9-9af0-4f49-aa11-2cdc943fa729 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:14.991508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:14.992135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:14.992414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:14.992685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.002755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.004202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:15.019271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:15.020246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:15.021775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:15.021775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:15.021775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:15.021775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 629/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:15.026294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.111334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:15.129979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20d37-e2f6-4876-b66d-8976b08a5f72 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:15.169299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:15.169905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:15.170185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:15.170458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.171129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:15.171426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.172774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.184494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 637/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:15.190524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.289211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f74a-d9fd-4ac1-9851-1748f256e24f None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:15.308799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:15.322862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:15.323512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:15.323798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:15.324072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.331304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.332747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:48:15.344063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:15.344997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:15.346254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 630/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:15.351725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.468121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d8e64-9a0c-4ab9-bd98-e46a9a13d69f None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:15.502111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:15.502709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:15.503015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:15.503281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.504009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:15.504313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.505717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.514657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:15.523716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 638/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:15.529476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.629932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5c2ab-7322-4bab-b612-6aef563cc9bd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:15.663461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:15.664069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:15.664342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:15.664609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.675457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.676919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:15.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:15.692164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:15.693417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:15.693417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:15.693417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:15.693417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 631/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:15.698055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.819244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3de2-aca6-4a8a-bafc-7a9f171cdc46 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:15.852709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:15.853303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:15.853578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:15.853842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:15.854468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:15.854788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:15.856142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:15.867211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 639/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:15.872930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:15.904955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:15.973498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579b54-4ccf-4e7c-b65b-dec58645ac25 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:16.007520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:16.008135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:16.008413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:16.008686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:16.017292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:16.018748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:48:16.030925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:16.032072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:16.033375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 632/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:48:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:16.038046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:16.098015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:16.139093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef70726-5275-46cd-b0e4-d190f5f6fe71 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:16.172856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:16.173447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:16.173720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:16.173985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:16.174664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:16.174991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:16.176403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58137659-78ca-47d2-aef4-7334bed6b773 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:16.188091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 640/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:16.194971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:16.285917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:16.294438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b46a-0303-4c76-b682-ab2c7df7805a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:16.328558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:16.329207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:16.329503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:16.329748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] PATH_INFO: `/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/90fb57878f024c05bdc9166eea624e73/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:16.331683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef03387a4c654f8d9aa777afe8877a9f, user_id=90fb57878f024c05bdc9166eea624e73, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:16.333141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ae7c8-d6b6-4516-a79d-c3929963fc82 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:16.417770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 633/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Thu Sep 1 17:48:16 2022] PUT /identity/v3/projects/ef03387a4c654f8d9aa777afe8877a9f/users/90fb57878f024c05bdc9166eea624e73/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:48:18.325388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eed70-e578-43b1-9574-f6b34c78c255 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:18.325936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eed70-e578-43b1-9574-f6b34c78c255 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:18.325936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eed70-e578-43b1-9574-f6b34c78c255 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:18.327299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 641/1274] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:18.332456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:18.332874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:18.332989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:18.351833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:18.353025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:18.418927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 634/1275] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:18.692301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eed70-e578-43b1-9574-f6b34c78c255 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:18.792559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eed70-e578-43b1-9574-f6b34c78c255 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:18.810932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:18.833503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:18.834209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:18.834834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:18.834834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:18.847407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:48:18.852809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:18.853969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:18.854918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 642/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Thu Sep 1 17:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:18.860397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:18.945554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:18.963624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709046b-e22b-4284-bc5b-1c4617973de0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:18.999203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:18.999807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.000086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.000357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.001013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:19.001320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.002684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.011748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 635/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Thu Sep 1 17:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:19.017625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:19.120357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee398c2-1509-4aea-93b3-0bb55f77af72 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:19.156096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:19.156780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.157060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.157329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.169022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.170445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:19.185247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:19.187710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:19.188826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:19.188826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:19.188826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:19.188826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 643/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:19.193282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:19.299371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271723e-06c7-4839-8c0f-9a7f6fe43137 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:19.333602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:19.336317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.336317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.336317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.336317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:19.336626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.338044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.349618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 636/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:19.356441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:19.386681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.454317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39590af-ab68-4745-833a-eb6ae61c66a6 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:19.488628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:19.489240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.489514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.489778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.498364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.499833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:48:19.515775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:19.516794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:19.517890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 644/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:19.524816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:19.530419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.627656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a820-0392-46b7-b78f-8e24b3bf643b None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:19.661305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:19.661901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.662198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.662623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.663895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:19.663895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.665072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.681551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 637/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:48:19.687870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:19.777720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.786866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6050a06-0e88-495a-86dd-5f3181cef967 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:19.820539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:19.821003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:19.821294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:19.821547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:19.889413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:19.890865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:19.979765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:19.989782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 645/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:48:19.996005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:20.056851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:20.095083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4269-888f-4378-8548-e0f96c39dbfd None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:20.128342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:20.128957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:20.129232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:20.129503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:20.139624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:20.141000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:48:20.156159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:20.162243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:48:20.163935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:48:20.163935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:48:20.163935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:20.163935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 638/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:20.164172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:20.260013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983b58c-ebbd-41db-9127-076465aec7a5 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:20.293542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:20.294219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:20.294498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:20.294791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:20.295424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:20.295723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:20.297130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:20.308934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 646/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Thu Sep 1 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:48:20.314970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:20.415010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc1c5-8b4f-496d-a289-d6d093dc8d30 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:20.428476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:20.448590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:20.449210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:20.449490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:20.449763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:20.456186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:20.457626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:48:20.469497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:20.471846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: ERROR keystone.server.flask.application Sep 01 17:48:20.472819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 639/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Thu Sep 1 17:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:20.476510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:20.527000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:20.574895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf012f-4b20-472e-af63-23f29ebed74c None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:20.609277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:20.609866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:20.610135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:20.610396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:20.611114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:20.611412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:20.612821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54c23-936f-458b-9a35-99e36fac29fe None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:20.624418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 647/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Thu Sep 1 17:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:20.630517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:20.731738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abaf3b-a9c9-4df9-95cb-560c53117b2a None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:20.766110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:20.766706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:20.767012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:20.767285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:20.768008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] RBAC: Adding query filter params (role.id=d8ad09c6864f4a43b015f988202955a4, scope.project.id=ef03387a4c654f8d9aa777afe8877a9f, user.id=90fb57878f024c05bdc9166eea624e73) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:20.768315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:20.769743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3ebb-4020-4d14-81d3-0e61ccaea188 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:20.775784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 640/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Thu Sep 1 17:48:20 2022] GET /identity/v3/role_assignments?user.id=90fb57878f024c05bdc9166eea624e73&scope.project.id=ef03387a4c654f8d9aa777afe8877a9f&role.id=d8ad09c6864f4a43b015f988202955a4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:22.729276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd6ab-fd99-40a7-90f1-c18b7304e374 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:22.729832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd6ab-fd99-40a7-90f1-c18b7304e374 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:22.729832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd6ab-fd99-40a7-90f1-c18b7304e374 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:22.731213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 648/1288] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:22.736530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:22.736947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:22.737062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:22.755146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:22.756960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:22.786848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:22.824187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 641/1289] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:23.093843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cd6ab-fd99-40a7-90f1-c18b7304e374 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:23.197317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cd6ab-fd99-40a7-90f1-c18b7304e374 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:23.207638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:23.229863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:23.230479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:23.230773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:23.231042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:23.231618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:23.232956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:23.241989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:23.246531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:23.247635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 649/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:48:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:23.249243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:23.351307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1036e-77bc-4ddf-92d2-2e5d7bc723a8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:23.384790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:23.385386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:23.385661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:23.385930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:23.386551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:23.386880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:23.388287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dab1-eeb4-4286-a836-47414cba7098 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:23.393018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 642/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Sep 1 17:48:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:23.398865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:23.497145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47519b9c-49d6-45c3-b474-6e754d27cdef None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:23.528771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:23.529358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:23.529632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:23.529912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] PATH_INFO: `/v3/services` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:23.530513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:23.530837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:23.532177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5425-7bd2-49a1-8f26-8f1e73e4306d None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:23.536414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 650/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Sep 1 17:48:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:25.533318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d44e-3b2c-4bad-b33c-2fa494d179fd None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:25.533899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d44e-3b2c-4bad-b33c-2fa494d179fd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:25.533899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d44e-3b2c-4bad-b33c-2fa494d179fd None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:25.535261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 643/1293] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:25.540594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba911f6-b991-40e0-a0b5-cb77b9f69b24 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:25.541046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba911f6-b991-40e0-a0b5-cb77b9f69b24 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:25.541160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba911f6-b991-40e0-a0b5-cb77b9f69b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:25.559646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-eba911f6-b991-40e0-a0b5-cb77b9f69b24 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:25.560848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-eba911f6-b991-40e0-a0b5-cb77b9f69b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:25.594315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:25.632357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 651/1294] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:25.903481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520d44e-3b2c-4bad-b33c-2fa494d179fd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:25.935159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:26.007918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520d44e-3b2c-4bad-b33c-2fa494d179fd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:26.042434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:26.043059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:26.043341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:26.043615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:26.044275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:26.045718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c9c8b-4f1d-44b5-80c4-42d8b0a5970d None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:26.126466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 644/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Thu Sep 1 17:48:25 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:48:28.072376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895052-4e8b-49ce-b690-2f2e387d9fb2 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:28.072918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895052-4e8b-49ce-b690-2f2e387d9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:28.072918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895052-4e8b-49ce-b690-2f2e387d9fb2 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:28.074317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 652/1296] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:48:28.079757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:28.080849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:28.080849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:28.098210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:28.099413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:28.171965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 645/1297] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:28.442672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895052-4e8b-49ce-b690-2f2e387d9fb2 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:28.541485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895052-4e8b-49ce-b690-2f2e387d9fb2 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:28.575389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:28.576007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:28.576285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:28.576552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:28.577130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:28.578548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:28.588186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:28.596385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:28.597480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 653/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:48:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:28.598356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:28.614440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:28.695529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aac30-e77e-41cb-8fc6-14a5961366d2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:28.730069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:28.730770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:28.731066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:28.731333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:28.731966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:28.732269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:28.733630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:28.738744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 646/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Sep 1 17:48:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:28.744896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:28.777443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:28.843749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87575c-1d33-4381-8f9c-2b145313bdb1 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:28.877168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:28.877770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:28.878033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:28.878300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:28.879012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] RBAC: Adding query filter params (interface=public, service_id=fe79db46c41d48948e60eaf249e9dbeb, region_id=RegionOne) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:28.879312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:28.880660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343596f6-adee-460c-b7e8-f307fdb65d40 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:28.886317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 654/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Thu Sep 1 17:48:28 2022] GET /identity/v3/endpoints?service_id=fe79db46c41d48948e60eaf249e9dbeb&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:28.892150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:28.975903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:28.993898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8b81-4ec7-4dee-b5af-340e59a31483 None admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:29.027323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:29.027969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:29.028248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:29.028519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:29.029123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:29.030487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78b39-b716-4f1c-bee1-2a9d5df34276 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:29.037131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 647/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Thu Sep 1 17:48:28 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:48:30.963742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef63c-fc33-43ec-a850-1b09d25267c4 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:30.964187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef63c-fc33-43ec-a850-1b09d25267c4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:30.964309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef63c-fc33-43ec-a850-1b09d25267c4 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:30.965599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 655/1302] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:48:30.970684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:30.971131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:30.975035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:30.989489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:48:30.990882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:48:31.056991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 648/1303] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:48:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:48:31.335651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcef63c-fc33-43ec-a850-1b09d25267c4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:31.438124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:31.445441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcef63c-fc33-43ec-a850-1b09d25267c4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:31.478493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:31.479159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:31.479448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:31.479905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:31.480730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:31.482426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:48:31.491823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:48:31.493066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application with Lock( Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: ERROR keystone.server.flask.application Sep 01 17:48:31.494110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 656/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Thu Sep 1 17:48:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:48:31.499191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:31.574631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:31.596648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc719-a2dd-4341-a618-3aa242f4e25f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:31.630243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:31.630911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:31.631181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:31.631446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] PATH_INFO: `/v3/services` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:31.632072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:48:31.632372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:31.633730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c411d8-ff8f-4872-a97a-2df806c374f9 None admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:31.638759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 649/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Thu Sep 1 17:48:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:48:31.644555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:48:31.748473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7d39-0a9c-4531-92f4-2ff65ad46317 None admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:48:31.782543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:48:31.783177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:48:31.783457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:48:31.783726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:48:31.784401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:48:31.785760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a438a-0bcb-4f3a-a01e-703789d2e3dd None admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:48:31.926381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 657/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:48:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:48:41.652279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=30 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:41.921849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:08.025893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e274-5ed0-4e8b-9d8f-cb13e829727b None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:08.026338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e274-5ed0-4e8b-9d8f-cb13e829727b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:08.026554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e274-5ed0-4e8b-9d8f-cb13e829727b None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:08.028193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 650/1307] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:08.033204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d564-2dba-4cc5-80e6-75f3216ba2ee None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:08.033623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d564-2dba-4cc5-80e6-75f3216ba2ee None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:08.033623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d564-2dba-4cc5-80e6-75f3216ba2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:08.120830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6697d564-2dba-4cc5-80e6-75f3216ba2ee None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:08.122063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6697d564-2dba-4cc5-80e6-75f3216ba2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:08.259168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 658/1308] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:08.546416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:08.546968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:08.547304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:08.548666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 651/1309] 10.222.0.58 () {54 vars in 965 bytes} [Thu Sep 1 17:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:08.554847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586acf0-b30f-4b26-be06-fafd4dd331a0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:08.555333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586acf0-b30f-4b26-be06-fafd4dd331a0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:08.555681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586acf0-b30f-4b26-be06-fafd4dd331a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:08.638628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c586acf0-b30f-4b26-be06-fafd4dd331a0 None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:08.640665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c586acf0-b30f-4b26-be06-fafd4dd331a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:08.663046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:08.723056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 659/1310] 10.222.0.58 () {58 vars in 1062 bytes} [Thu Sep 1 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:08.733793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:08.736109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:08.865854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b29919-f57d-4e57-ad08-76c69595d26f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:08.951249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:08.952506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:08.952787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:08.953057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:08.954660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:09.013936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:09.070561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:09.072045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e2ffa-d865-442e-b1bf-16679fd06eeb service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:09.093676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 652/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:11.336288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:11.336861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:11.337087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:11.342990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 660/1312] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:11.344848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6863cd-d918-46fb-b8fa-e8f1fb7f1580 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:11.345648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6863cd-d918-46fb-b8fa-e8f1fb7f1580 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:11.345922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6863cd-d918-46fb-b8fa-e8f1fb7f1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:11.429140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-fb6863cd-d918-46fb-b8fa-e8f1fb7f1580 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:11.430386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fb6863cd-d918-46fb-b8fa-e8f1fb7f1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:11.538276 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 653/1313] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:11.820481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:11.822023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:11.934373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef8d3-ae04-4dca-a3fd-2eb59d281605 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:12.005926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:12.008399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:12.008996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:12.009272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:12.009540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:12.011160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:12.122566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:12.124539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66720332-f704-46e6-b643-5b03aacea947 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:12.146219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 661/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:14.548850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:14.549389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:14.549389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:14.550745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 654/1315] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:14.555881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b641-fabf-4de5-b7db-a4a56de498a0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:14.556311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b641-fabf-4de5-b7db-a4a56de498a0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:14.556417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b641-fabf-4de5-b7db-a4a56de498a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:14.622097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9187b641-fabf-4de5-b7db-a4a56de498a0 None None] MFA Rules not processed for user `d5742535bacd4069bdbcaa747219e771`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:14.623295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9187b641-fabf-4de5-b7db-a4a56de498a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:14.673808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:14.718942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 662/1316] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:15.017117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:15.018649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:15.028433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:15.132346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d176d-4c53-42d1-9be4-b7fd733fe270 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:15.210625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:15.211240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:15.211512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:15.211778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:15.213368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:15.276573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:15.323546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:15.325012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338e87f-0e35-445f-89f0-e9b8a6fb2c8a service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:15.344361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 655/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:18.121146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:18.121698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:18.121698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:18.123088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 663/1318] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:18.129246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f5312-2eae-46f5-b090-4862150b087b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:18.129694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f5312-2eae-46f5-b090-4862150b087b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:18.129816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f5312-2eae-46f5-b090-4862150b087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:18.197337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-642f5312-2eae-46f5-b090-4862150b087b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:18.198558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-642f5312-2eae-46f5-b090-4862150b087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:18.297321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 656/1319] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:55:18.590050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:18.591646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:18.691372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b20e6-d8a8-41b7-9b13-dd39ca14ed8e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:18.761478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:18.762065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:18.762339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:18.762602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:18.764979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:18.772089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:18.871722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:18.873074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa23f2-8f89-4ed7-b7e8-b70fa22d4b4f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:18.892150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 664/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:21.790705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd85716-19dc-4fff-89e7-6c6704f527aa None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:21.791251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd85716-19dc-4fff-89e7-6c6704f527aa None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:21.791251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd85716-19dc-4fff-89e7-6c6704f527aa None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:21.792602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 657/1321] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:21.798448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f1d8-c29c-43da-a507-795ca4d45871 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:21.798906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f1d8-c29c-43da-a507-795ca4d45871 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:21.799146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f1d8-c29c-43da-a507-795ca4d45871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:21.866296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d0a5f1d8-c29c-43da-a507-795ca4d45871 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:21.867462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d0a5f1d8-c29c-43da-a507-795ca4d45871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:21.927002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:21.968809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 665/1322] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:22.280203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:22.281182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:22.281465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:22.282865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 658/1323] 10.222.0.58 () {54 vars in 965 bytes} [Thu Sep 1 17:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:22.288888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609c9-fb94-4152-91e6-45dcfec69bc6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:22.289174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609c9-fb94-4152-91e6-45dcfec69bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:22.289444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609c9-fb94-4152-91e6-45dcfec69bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:22.378746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-698609c9-fb94-4152-91e6-45dcfec69bc6 None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:22.379975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-698609c9-fb94-4152-91e6-45dcfec69bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:22.460358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 666/1324] 10.222.0.58 () {58 vars in 1062 bytes} [Thu Sep 1 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:22.469203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:22.470785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:22.490899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:22.578858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850ba57-c26e-4afb-8936-eb9850a0dccf None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:22.653691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:22.654292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:22.654711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:22.655443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:22.657053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:22.736699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:22.778020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:22.779526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba39e78-3792-4628-87e1-5341a66eb51f service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:22.798961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 659/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:24.996474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:24.996996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:24.996996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:24.998923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 667/1326] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:25.004270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5762-1a8d-404c-8eeb-46cba0d2f2fc None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:25.004730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5762-1a8d-404c-8eeb-46cba0d2f2fc None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:25.004954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd5762-1a8d-404c-8eeb-46cba0d2f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:25.078798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-43bd5762-1a8d-404c-8eeb-46cba0d2f2fc None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:25.080046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-43bd5762-1a8d-404c-8eeb-46cba0d2f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:25.181219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 660/1327] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:25.465794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:25.467498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:25.528771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:25.573116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283906b-bdcd-4b66-a47e-48861dc70be3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:25.649337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:25.649337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:25.649337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:25.649337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:25.651322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:25.760196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:25.762735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:25.765168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c849-5aab-4e1c-aa82-c9b1b535f9a9 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:25.784655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 668/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:27.759612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:27.760081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:27.760173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:27.761607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 661/1329] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:27.767087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743655-dc5e-4672-a994-27b086e59cb6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:27.767491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743655-dc5e-4672-a994-27b086e59cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:27.767633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87743655-dc5e-4672-a994-27b086e59cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:27.861364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-87743655-dc5e-4672-a994-27b086e59cb6 None None] MFA Rules not processed for user `d5742535bacd4069bdbcaa747219e771`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:27.862680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87743655-dc5e-4672-a994-27b086e59cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:27.976408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 669/1330] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:28.269721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:28.271329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:28.302769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:28.376941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62899-4be1-41ac-ad80-803992deb48c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:28.454603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:28.455182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:28.455464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:28.455738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:28.457370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:28.541130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:28.576045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:28.577993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195fe04-36ee-4022-9b9a-ef1c85c34bb5 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:28.598843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 662/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:31.162921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:31.163450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:31.163450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:31.164805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 670/1332] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:31.169868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c3ec-cf34-4561-b5df-695cc292a8d5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:31.170362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c3ec-cf34-4561-b5df-695cc292a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:31.170687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c3ec-cf34-4561-b5df-695cc292a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:31.238091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4638c3ec-cf34-4561-b5df-695cc292a8d5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:31.239257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4638c3ec-cf34-4561-b5df-695cc292a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:31.335163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 663/1333] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:31.626964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:31.628568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:31.699836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:31.734849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1e30-2a5f-4bc8-a776-f830f1d09f59 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:31.809552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:31.810154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:31.810427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:31.811777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:31.813390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:31.930488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:31.931898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965b617-dae0-48c6-b6cb-e22726021c5e service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:31.942987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:31.951199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 671/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:33.972912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:33.973340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:33.973449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:33.975033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 664/1335] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:33.980387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd637a-ee4f-4d31-9bbe-ab98775769b6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:33.980828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd637a-ee4f-4d31-9bbe-ab98775769b6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:33.980926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd637a-ee4f-4d31-9bbe-ab98775769b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:34.045626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a1fd637a-ee4f-4d31-9bbe-ab98775769b6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:34.047027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a1fd637a-ee4f-4d31-9bbe-ab98775769b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:34.141671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 672/1336] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:34.474275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:34.475996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:34.520449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:34.585180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c474565-80dc-4366-90d4-62a5b57886ef None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:34.662364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:34.663005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:34.663281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:34.663548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:34.665118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:34.747736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:34.773198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:34.774628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b645f-210b-4609-a1d4-1ec85fbd8224 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:34.793510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 665/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:37.515324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:37.515908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:37.515908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:37.517228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 673/1338] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:37.522393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24c9f-eb6b-4631-9f19-fe0d0910ef35 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:37.522867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24c9f-eb6b-4631-9f19-fe0d0910ef35 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:37.522983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24c9f-eb6b-4631-9f19-fe0d0910ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:37.588257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a4a24c9f-eb6b-4631-9f19-fe0d0910ef35 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:37.589457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a4a24c9f-eb6b-4631-9f19-fe0d0910ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:37.686182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 666/1339] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:37.990458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:37.992080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:38.067761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:38.095661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324b5df-5878-4f77-ac9f-1de23ab3d3d7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:38.178716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:38.179466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:38.179762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:38.180012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:38.183048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:38.292690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:38.294206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580960db-5e1b-40b3-b809-63d58ba8b96d service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:38.314119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 674/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:42.467818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:42.468345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:42.468345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:42.469810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 667/1341] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:42.474850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4a90-88f7-4548-89c4-0fb312c0dd84 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:42.475278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4a90-88f7-4548-89c4-0fb312c0dd84 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:42.475380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4a90-88f7-4548-89c4-0fb312c0dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:42.480750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:42.542641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5acf4a90-88f7-4548-89c4-0fb312c0dd84 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:42.543906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5acf4a90-88f7-4548-89c4-0fb312c0dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:42.647011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 675/1342] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:42.928747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:42.930321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:42.981086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:43.038106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e2f0-6fdf-499e-be15-df8400eb21d1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:43.113438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:43.114043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:43.114327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:43.114601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:43.116319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:43.210271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:43.227224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:43.228670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e976ac-b2cd-4166-92c5-ca7132bdaf67 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:43.253397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 668/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:46.208163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:46.208687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:46.208687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:46.210208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 676/1344] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:46.215499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792189-10cc-4119-a518-168425c47fa6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:46.215923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792189-10cc-4119-a518-168425c47fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:46.216050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87792189-10cc-4119-a518-168425c47fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:46.289088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-87792189-10cc-4119-a518-168425c47fa6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:46.290317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-87792189-10cc-4119-a518-168425c47fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:46.391335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 669/1345] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:55:46.680754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:46.682339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:46.770679 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:46.787778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa781-6e1a-40d2-8f6e-10baa8847c78 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:46.866896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:46.867498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:46.867840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:46.868177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:46.869841 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:46.984343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:46.985810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed9527-47d9-4429-ac9c-0c0ac3e45097 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:47.006885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 677/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:51.240277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:51.240774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:51.240901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:51.242164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 670/1347] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:51.247508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999593-940f-48a7-9053-71c514120287 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:51.248470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999593-940f-48a7-9053-71c514120287 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:51.248632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999593-940f-48a7-9053-71c514120287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:51.265640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:51.321957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-94999593-940f-48a7-9053-71c514120287 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:51.323206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-94999593-940f-48a7-9053-71c514120287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:51.426356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 678/1348] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:55:51.710845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:55:51.712390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:51.781733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:51.838550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2afde-becf-4030-a8a8-a9dde3643012 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:55:51.921133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:55:51.921751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:51.922120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:51.922311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:51.923971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:52.041535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:55:52.046047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:55:52.047575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04941fa7-cf84-4531-90f7-2b5bcc6daca8 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:55:52.066078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 671/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:55:57.127624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517dc-104f-493d-93d8-a80e82940ef4 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:57.128092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517dc-104f-493d-93d8-a80e82940ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:57.128177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717517dc-104f-493d-93d8-a80e82940ef4 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:57.129842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 679/1350] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 17:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:55:57.134980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd23d-67f6-404f-81ca-ce8e61fc2c55 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:55:57.135387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd23d-67f6-404f-81ca-ce8e61fc2c55 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:55:57.135546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd23d-67f6-404f-81ca-ce8e61fc2c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:55:57.236160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6fbfd23d-67f6-404f-81ca-ce8e61fc2c55 None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:55:57.237396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6fbfd23d-67f6-404f-81ca-ce8e61fc2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:55:57.379379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 672/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:01.426651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=59 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:01.729937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ac3d-c04b-4fdf-8eb5-74c07063f776 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:01.730124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ac3d-c04b-4fdf-8eb5-74c07063f776 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:01.730398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ac3d-c04b-4fdf-8eb5-74c07063f776 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:01.733042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 680/1352] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 17:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:01.738227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fac4-dd83-4cdb-97cc-84855804130d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:01.738712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fac4-dd83-4cdb-97cc-84855804130d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:01.739052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805fac4-dd83-4cdb-97cc-84855804130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:01.800785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:01.824515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2805fac4-dd83-4cdb-97cc-84855804130d None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:01.825928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2805fac4-dd83-4cdb-97cc-84855804130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:01.947786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 673/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:03.595700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77bb8-85a1-439e-b4fd-867d264076ea None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:03.596139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77bb8-85a1-439e-b4fd-867d264076ea None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:03.596329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77bb8-85a1-439e-b4fd-867d264076ea None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:03.597678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 681/1354] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 17:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:03.602709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ce427-8c38-4940-9763-8ed9be1825b9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:03.603162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ce427-8c38-4940-9763-8ed9be1825b9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:03.603274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ce427-8c38-4940-9763-8ed9be1825b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:03.681918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-823ce427-8c38-4940-9763-8ed9be1825b9 None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:03.683171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-823ce427-8c38-4940-9763-8ed9be1825b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:03.727403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:03.798307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 674/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:56:07.100206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7488-5c30-4e42-a3a3-5cbd91f6a265 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:07.100789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7488-5c30-4e42-a3a3-5cbd91f6a265 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:07.100982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7488-5c30-4e42-a3a3-5cbd91f6a265 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:07.102179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 682/1356] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:07.108454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ed4c-1b0b-4739-a589-1b0cc7c579de None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:07.109308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ed4c-1b0b-4739-a589-1b0cc7c579de None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:07.109588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ed4c-1b0b-4739-a589-1b0cc7c579de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:07.201252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3094ed4c-1b0b-4739-a589-1b0cc7c579de None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:07.202557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3094ed4c-1b0b-4739-a589-1b0cc7c579de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:07.332846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 675/1357] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:07.653148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:07.654661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:07.655440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:07.658116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 683/1358] 10.222.0.58 () {54 vars in 962 bytes} [Thu Sep 1 17:56:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:07.667120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e6f5-821a-4ba9-89fb-546e4663a160 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:07.667427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e6f5-821a-4ba9-89fb-546e4663a160 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:07.667677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e6f5-821a-4ba9-89fb-546e4663a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:07.685254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:07.751257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9839e6f5-821a-4ba9-89fb-546e4663a160 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:07.752452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9839e6f5-821a-4ba9-89fb-546e4663a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:07.880309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 676/1359] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Sep 1 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:07.888934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:07.890673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:08.051090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669da8d7-70ac-4447-8f75-dbb6684b6d09 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:08.130965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:08.175088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:08.175839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:08.176215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:08.176579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:08.178312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:08.274417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:08.276333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc33c3-99cb-4b66-98b4-40f99a56909d service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:08.298813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 684/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:10.495571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:10.496147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:10.496338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:10.498407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 677/1361] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:10.504088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147b71-3080-4cb9-af89-5a54355ec0c7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:10.504546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147b71-3080-4cb9-af89-5a54355ec0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:10.504640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147b71-3080-4cb9-af89-5a54355ec0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:10.582948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8e147b71-3080-4cb9-af89-5a54355ec0c7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:10.585051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8e147b71-3080-4cb9-af89-5a54355ec0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:10.625182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:10.683731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 685/1362] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:10.976745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:10.978308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:11.053666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:11.140933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f924d-c613-4c14-800b-49469728a7c7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:11.273624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:11.274361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:11.274642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:11.274945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:11.276565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:11.302226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:11.379350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:11.381179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5331f1-7834-40e5-b40a-c106f9090bbb service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:11.401641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 678/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:13.852517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00dfcb-f4ca-4eba-af72-7adbde941248 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:13.853122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00dfcb-f4ca-4eba-af72-7adbde941248 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:13.853122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00dfcb-f4ca-4eba-af72-7adbde941248 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:13.854354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 686/1364] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:13.860433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55bd1b-95d5-4ca0-8bc9-671e6206c038 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:13.860884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55bd1b-95d5-4ca0-8bc9-671e6206c038 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:13.860970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55bd1b-95d5-4ca0-8bc9-671e6206c038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:13.929888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-dd55bd1b-95d5-4ca0-8bc9-671e6206c038 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:13.931124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dd55bd1b-95d5-4ca0-8bc9-671e6206c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:14.042807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:14.051114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 679/1365] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:14.349042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:14.349737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:14.350130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:14.351822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 687/1366] 10.222.0.58 () {54 vars in 962 bytes} [Thu Sep 1 17:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:14.357847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42316-66df-4249-9328-7e7f16e45559 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:14.358209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42316-66df-4249-9328-7e7f16e45559 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:14.358579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42316-66df-4249-9328-7e7f16e45559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:14.441091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0bc42316-66df-4249-9328-7e7f16e45559 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:14.442471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0bc42316-66df-4249-9328-7e7f16e45559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:14.570086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 680/1367] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Sep 1 17:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:14.578600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:14.580316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:14.757726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe54fc-b76b-42ab-ae97-b2c8fc9c06c3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:14.779238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:14.885796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:14.886498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:14.886777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:14.886966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:14.888819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:14.993031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:14.994926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e91bf-4a9e-473f-bd4a-760175429304 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:15.014981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 688/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:15.467190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f6d7-aa53-41ba-a826-bc3c8567d266 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:15.467843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f6d7-aa53-41ba-a826-bc3c8567d266 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:15.467843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2f6d7-aa53-41ba-a826-bc3c8567d266 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:15.469174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 681/1369] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:56:15.474362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035848-341b-4e6c-a72e-660655af453b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:15.474651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035848-341b-4e6c-a72e-660655af453b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:15.474971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035848-341b-4e6c-a72e-660655af453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:15.508584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:15.544681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cd035848-341b-4e6c-a72e-660655af453b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:15.545942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cd035848-341b-4e6c-a72e-660655af453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:15.648470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 689/1370] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:16.232808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:16.232808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:16.232808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:16.232808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 682/1371] 10.222.0.58 () {54 vars in 964 bytes} [Thu Sep 1 17:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:16.236763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03774-2236-49cf-8af8-f04aeb9c13d8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:16.237189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03774-2236-49cf-8af8-f04aeb9c13d8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:16.237279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03774-2236-49cf-8af8-f04aeb9c13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:16.324415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5ff03774-2236-49cf-8af8-f04aeb9c13d8 None None] MFA Rules not processed for user `e162ed7a337a40f5875048254f16a2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:16.325773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5ff03774-2236-49cf-8af8-f04aeb9c13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:16.379261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:16.412028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 690/1372] 10.222.0.58 () {58 vars in 1061 bytes} [Thu Sep 1 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:16.419703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:16.421347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:16.473879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:16.528175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f309ed8-26a8-4267-8cdf-9ba869be0706 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:16.606400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:16.607723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:16.608044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:16.608376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:16.610028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:16.713354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:16.730168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:16.732713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b4f6f-636c-472c-88cd-37a5028b4ab2 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:16.754239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 683/1373] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:17.264190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:17.264735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:17.264735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:17.266007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 691/1374] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:17.271436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62019b-69c4-4f38-918a-509d0b07a6ab None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:17.271742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62019b-69c4-4f38-918a-509d0b07a6ab None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:17.272031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62019b-69c4-4f38-918a-509d0b07a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:17.340225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1e62019b-69c4-4f38-918a-509d0b07a6ab None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:17.341629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1e62019b-69c4-4f38-918a-509d0b07a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:17.443960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 684/1375] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:17.735489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:17.737022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:17.883950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff850f-f383-4257-8500-a2aba2837912 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:17.939189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:18.002870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:18.003480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:18.003762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:18.004035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:18.005637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:18.095078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:18.096675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e04e2-f139-4b07-bca4-5688a34385f6 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:18.115162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 692/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:20.323938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:20.324499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:20.324650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:20.326772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 685/1377] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:20.332096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596271-a091-44f4-bf0e-c5ace9dab984 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:20.332522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596271-a091-44f4-bf0e-c5ace9dab984 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:20.332772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596271-a091-44f4-bf0e-c5ace9dab984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:20.403988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-26596271-a091-44f4-bf0e-c5ace9dab984 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:20.405214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26596271-a091-44f4-bf0e-c5ace9dab984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:20.411957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:20.514955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 693/1378] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:20.815230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:20.816812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:20.885448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:21.005486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81043b68-5d1d-4f63-977b-57bff4ac3108 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:21.126684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:21.127316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:21.127589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:21.127856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:21.129444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:21.150082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:21.227311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:21.228919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a578-04fa-49d8-9fea-bb9ae856bdc1 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:21.254109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 686/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:23.444507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:23.445351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:23.445351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:23.446817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 694/1380] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:23.452314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a752-79f1-473e-9684-63a733c16082 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:23.452711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a752-79f1-473e-9684-63a733c16082 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:23.452895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a752-79f1-473e-9684-63a733c16082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:23.535736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0185a752-79f1-473e-9684-63a733c16082 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:23.536985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0185a752-79f1-473e-9684-63a733c16082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:23.635446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:23.641832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 687/1381] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:56:23.928986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:23.930495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:24.083864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:24.095913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54e36c-626a-4b46-bfad-bd3891457281 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:24.223737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:24.224425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:24.224835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:24.225209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:24.227012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:24.322620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:24.324411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5228597-bccc-4bdf-b606-017e4fc969d4 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:24.335919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:24.345169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 695/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:26.730208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:26.730797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:26.730940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:26.733268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 688/1383] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:26.740160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81eb60-8986-4188-96a3-b4b43cdb7cfb None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:26.740681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81eb60-8986-4188-96a3-b4b43cdb7cfb None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:26.740681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81eb60-8986-4188-96a3-b4b43cdb7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:26.813995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2a81eb60-8986-4188-96a3-b4b43cdb7cfb None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:26.815258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2a81eb60-8986-4188-96a3-b4b43cdb7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:26.915196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 696/1384] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:27.209463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:27.211748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:27.402994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858119-d34e-423b-bd64-f67ea5213f5a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:27.486776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:27.538027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:27.538638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:27.539031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:27.539325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:27.541025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:27.641204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:27.642918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c007-ca7f-40dd-9fd1-f97f0399ebab service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:27.662865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 689/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:29.610209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:29.610709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:29.610924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:29.612137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 697/1386] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:29.617565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f166e5-6476-44b6-8471-b9816275ba89 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:29.618035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f166e5-6476-44b6-8471-b9816275ba89 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:29.618182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f166e5-6476-44b6-8471-b9816275ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:29.703401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-02f166e5-6476-44b6-8471-b9816275ba89 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:29.704768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-02f166e5-6476-44b6-8471-b9816275ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:29.738312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:29.807223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 690/1387] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:56:30.145066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:30.146585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:30.223707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:30.293394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8c90-e3d1-4227-8527-3dc59835a162 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:30.407721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:30.408322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:30.408596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:30.408861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:30.410458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:30.447981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:30.501351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:30.502923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b292e63-a638-4a33-b09e-3ac1b95ef3ef service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:30.521789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 698/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:32.722046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:32.722660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:32.722660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:32.723957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 691/1389] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:32.729176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208737f-7552-4687-b62c-cf2253370761 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:32.729613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208737f-7552-4687-b62c-cf2253370761 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:32.729705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208737f-7552-4687-b62c-cf2253370761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:32.799068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b208737f-7552-4687-b62c-cf2253370761 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:32.800284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b208737f-7552-4687-b62c-cf2253370761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:32.902247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 699/1390] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:33.209266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:33.211128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:33.359169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e2f9-cf25-4bf0-94c8-9b55d5d024ff None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:33.375979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:33.473528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:33.474134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:33.474413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:33.474686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:33.476317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:33.567441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:33.569050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5970ee-5d41-40aa-98dc-2ecae7de554d service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:33.587717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 692/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:33.615702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a153-2052-41cb-9352-1601c1a914a7 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:33.615702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a153-2052-41cb-9352-1601c1a914a7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:33.615702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a153-2052-41cb-9352-1601c1a914a7 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:33.615702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 700/1392] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:33.616532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddd131-6bab-4a56-9d00-d6213912e3a2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:33.616822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddd131-6bab-4a56-9d00-d6213912e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:33.617101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddd131-6bab-4a56-9d00-d6213912e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:33.642705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:33.684964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b6ddd131-6bab-4a56-9d00-d6213912e3a2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:33.686188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b6ddd131-6bab-4a56-9d00-d6213912e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:33.786240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 693/1393] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:34.092092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:34.092605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:34.092710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:34.094034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 701/1394] 10.222.0.58 () {54 vars in 967 bytes} [Thu Sep 1 17:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:34.099336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8445d-22dc-4c2e-a537-da2e5c7b4fb8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:34.099629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8445d-22dc-4c2e-a537-da2e5c7b4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:34.099907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8445d-22dc-4c2e-a537-da2e5c7b4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:34.185037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bda8445d-22dc-4c2e-a537-da2e5c7b4fb8 None None] MFA Rules not processed for user `55c40c8bb3b24e07b3189f84acd4ca02`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:34.186265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bda8445d-22dc-4c2e-a537-da2e5c7b4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:34.235329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:34.266653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 694/1395] 10.222.0.58 () {58 vars in 1064 bytes} [Thu Sep 1 17:56:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:34.274495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:34.276039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:34.296099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:34.388373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f3ffa-6171-4e22-8cf0-a523dc66f04e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:34.460585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:34.461193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:34.461468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:34.461734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:34.463343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:34.536895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:34.578951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:34.580371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42afb0-5b13-449f-aeee-aa44354c4458 service glance] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:34.598718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 702/1396] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:35.655609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce52db-3b33-4e56-a0ff-3af722d7da9b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:35.656088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce52db-3b33-4e56-a0ff-3af722d7da9b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:35.656192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce52db-3b33-4e56-a0ff-3af722d7da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:35.725985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359e53-5ed6-4056-a0d5-6e730f96abed None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:35.726521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359e53-5ed6-4056-a0d5-6e730f96abed None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:35.726673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359e53-5ed6-4056-a0d5-6e730f96abed None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:35.727284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-97ce52db-3b33-4e56-a0ff-3af722d7da9b None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:35.728018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 703/1397] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:56:35.728507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-97ce52db-3b33-4e56-a0ff-3af722d7da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:35.735011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:35.735359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:35.735723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:35.835261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 695/1398] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:35.836114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:35.837343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:35.878891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caff7-9486-43ec-ab47-4165ca99ff6f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:35.879182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caff7-9486-43ec-ab47-4165ca99ff6f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:35.879462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48caff7-9486-43ec-ab47-4165ca99ff6f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:35.880803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 696/1399] 10.222.0.58 () {54 vars in 943 bytes} [Thu Sep 1 17:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:56:35.886747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:35.887032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:35.887340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:35.944585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 704/1400] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:56:35.960530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:35.968593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] MFA Rules not processed for user `86f47c546d1b47d69252eaa11b5a3f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:35.974357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:36.077088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 697/1401] 10.222.0.58 () {58 vars in 1040 bytes} [Thu Sep 1 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:56:36.086544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:36.087876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:36.120614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:36.200481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d90e-948a-4e19-a787-b95456bba06a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:36.247148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:36.248523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:36.309551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:36.310169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:36.310454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:36.310740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:36.312401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:36.351138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcfb08-54cf-425d-b85e-ae00b8b33cfc None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:36.355099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:36.373607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:36.398827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:36.400468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13651c30-41f4-4659-a0af-ec0ace388bdb service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:36.408938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 705/1402] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 17:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:56:36.481932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:36.482635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:36.482967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:36.483218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:36.484818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:36.574323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:36.576537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcbfcf-d780-412a-811e-ae23c90c350b service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:36.594551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 698/1403] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:56:40.094148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:40.094711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:40.094711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:40.100302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 706/1404] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:40.103232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c1b2-2c46-4741-b563-6c7e4132c0a5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:40.103685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c1b2-2c46-4741-b563-6c7e4132c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:40.103781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c1b2-2c46-4741-b563-6c7e4132c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:40.139738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:40.176076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0100c1b2-2c46-4741-b563-6c7e4132c0a5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:40.177733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0100c1b2-2c46-4741-b563-6c7e4132c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:40.288903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 699/1405] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:40.599483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:40.601075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:40.889513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0868-3860-4bf7-8092-323e55ffb649 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:40.941594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:41.032606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:41.033214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:41.033489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:41.033757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:41.035512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:41.133586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:41.135239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c9c5-08fa-4985-ac75-2aa8620daa94 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:41.157727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 707/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:43.293165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:43.294408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:43.294408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:43.296708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 700/1407] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:56:43.302215 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252889-7bd1-4ed1-83cb-36c269bcb488 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:43.302713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252889-7bd1-4ed1-83cb-36c269bcb488 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:43.303416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252889-7bd1-4ed1-83cb-36c269bcb488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:43.361730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:43.380655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-18252889-7bd1-4ed1-83cb-36c269bcb488 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:56:43.381868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-18252889-7bd1-4ed1-83cb-36c269bcb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:43.487900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 708/1408] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:56:43.780032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:56:43.781537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:43.895901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:43.952905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf61b2-ae17-432c-8302-909f58b463e8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:56:44.082054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:56:44.082793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:56:44.083142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:56:44.083420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:56:44.085052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:56:44.168974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:44.192746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:56:44.194368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137accfb-1ae1-4c07-a368-a5d7447abb7a service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:56:44.214215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 701/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:56:53.486005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=47 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:54.215598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=16 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:01.259367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4555-f079-42b0-92fd-2a7cf49a08fb None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:01.259925 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4555-f079-42b0-92fd-2a7cf49a08fb None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:01.259925 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4555-f079-42b0-92fd-2a7cf49a08fb None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:01.261151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 709/1410] 10.222.0.58 () {54 vars in 918 bytes} [Thu Sep 1 17:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:01.266765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848fb5c-3d13-459d-8a48-ddeaf37fc7c1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:01.267199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848fb5c-3d13-459d-8a48-ddeaf37fc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:01.267428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848fb5c-3d13-459d-8a48-ddeaf37fc7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:01.345344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7848fb5c-3d13-459d-8a48-ddeaf37fc7c1 None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:01.346560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7848fb5c-3d13-459d-8a48-ddeaf37fc7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:01.452221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 702/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Sep 1 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:57:01.467261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a315-7949-49f0-a219-ec31e092403b None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:01.467569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a315-7949-49f0-a219-ec31e092403b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:01.467837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a315-7949-49f0-a219-ec31e092403b None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:01.469156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 710/1412] 10.222.0.58 () {54 vars in 918 bytes} [Thu Sep 1 17:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:01.473892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e5be-d164-4f41-934f-020b75b5f34f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:01.474171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e5be-d164-4f41-934f-020b75b5f34f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:01.474440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e5be-d164-4f41-934f-020b75b5f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:01.554164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:01.556838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1ff9e5be-d164-4f41-934f-020b75b5f34f None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:01.558064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1ff9e5be-d164-4f41-934f-020b75b5f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:01.678315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 703/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Sep 1 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:57:04.056386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:04.056946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:04.056946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:04.058241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:04.064167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b580-c895-4ab6-8524-d7540197937a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:04.064623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b580-c895-4ab6-8524-d7540197937a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:04.064731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b580-c895-4ab6-8524-d7540197937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:04.130454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-09c3b580-c895-4ab6-8524-d7540197937a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:04.131736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-09c3b580-c895-4ab6-8524-d7540197937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:04.186162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:04.227907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:04.518523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:04.520055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:04.666428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd09e3-6e50-4fcd-9f06-f76119687f10 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:04.737258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:04.781845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:04.781845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:04.781845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:04.781845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:04.782625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:04.873379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:04.874987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de3130-5760-4ee2-afda-e7e3cc719447 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:04.893001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 712/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:05.810391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4656e-acaf-4645-b837-eea74350421e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:05.810988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4656e-acaf-4645-b837-eea74350421e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:05.810988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4656e-acaf-4645-b837-eea74350421e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:05.812288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:05.817287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2601d-bb16-417d-b3c8-ca3edd0f5cf3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:05.817746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2601d-bb16-417d-b3c8-ca3edd0f5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:05.817854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2601d-bb16-417d-b3c8-ca3edd0f5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:05.893049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cda2601d-bb16-417d-b3c8-ca3edd0f5cf3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:05.894176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cda2601d-bb16-417d-b3c8-ca3edd0f5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:05.920840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:05.992300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:06.143748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4656e-acaf-4645-b837-eea74350421e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:06.145286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-78f4656e-acaf-4645-b837-eea74350421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:06.296479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4656e-acaf-4645-b837-eea74350421e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:06.337282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:06.411051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:06.411575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:06.411854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:06.412125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:06.413745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:06.502003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:06.503634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b2ea5-2abe-486e-8877-b086beb2f32f service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:06.521958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 706/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:07.431224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:07.431786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:07.431786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:07.433111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:07.438814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13e65-6e7f-4705-9057-e45d2aad5ab0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:07.439241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13e65-6e7f-4705-9057-e45d2aad5ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:07.439351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13e65-6e7f-4705-9057-e45d2aad5ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:07.497761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:07.519285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e2d13e65-6e7f-4705-9057-e45d2aad5ab0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:07.520496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e2d13e65-6e7f-4705-9057-e45d2aad5ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:07.620561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:07.779469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:07.781024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:07.928725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2984f-e169-423b-a753-b606d37f8d62 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:07.940897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:08.046930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:08.046930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:08.046930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:08.047335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:08.048630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:08.141593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:08.143209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6efb70-9c2f-4093-8a4f-38a3bff1c35d service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:08.161354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 715/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:09.030591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:09.031160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:09.031160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:09.032505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:09.037546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fd69-08ef-49b0-ba7d-8df20fdf0cf8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:09.037963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fd69-08ef-49b0-ba7d-8df20fdf0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:09.038094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fd69-08ef-49b0-ba7d-8df20fdf0cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:09.058237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:09.115849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3216fd69-08ef-49b0-ba7d-8df20fdf0cf8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:09.117057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3216fd69-08ef-49b0-ba7d-8df20fdf0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:09.213772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:09.368994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:09.370507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:09.487099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:09.521551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537d80-304e-40cf-8c12-0de2ac0db0b7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:09.634923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:09.635523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:09.635799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:09.636067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:09.638291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:09.718253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:09.731544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:09.733187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729c27b-aeb6-4520-9454-818e5f479159 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:09.751582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 709/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:10.604815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:10.605962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:10.605962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:10.607434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:10.612241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590e7f-3f81-4265-998f-b0b9775e67a2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:10.612669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590e7f-3f81-4265-998f-b0b9775e67a2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:10.612775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590e7f-3f81-4265-998f-b0b9775e67a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:10.687501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-37590e7f-3f81-4265-998f-b0b9775e67a2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:10.688705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-37590e7f-3f81-4265-998f-b0b9775e67a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:10.791834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:10.943350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:10.944785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:11.031462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:11.096762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dc22d-30cc-4248-8c68-5656dbfdf128 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:11.216881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:11.217400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:11.217675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:11.217941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:11.219618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:11.270295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:11.313166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:11.314786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62dc2a7-d083-4a28-9317-11ebed67528b service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:11.333004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 718/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:12.215381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:12.215913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:12.215913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:12.217243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:12.222292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc7da-7979-4e3b-a7d2-c34d9a308993 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:12.222714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc7da-7979-4e3b-a7d2-c34d9a308993 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:12.222857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc7da-7979-4e3b-a7d2-c34d9a308993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:12.298399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-fdedc7da-7979-4e3b-a7d2-c34d9a308993 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:12.299674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fdedc7da-7979-4e3b-a7d2-c34d9a308993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:12.394797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:12.545792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:12.547364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:12.596776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:12.692584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9e551-45b3-46b8-9ffa-9d654665d48d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:12.803861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:12.804393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:12.804668 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:12.804938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:12.806515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:12.813523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:12.895401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:12.896982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512d2d3-b832-47ca-905d-f75b71e2b7d1 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:12.915001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 712/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:13.799535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:13.800106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:13.800225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:13.801498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:13.806597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f587c-4db8-4e14-ae10-321b036a0234 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:13.807038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f587c-4db8-4e14-ae10-321b036a0234 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:13.807194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f587c-4db8-4e14-ae10-321b036a0234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:13.885704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-457f587c-4db8-4e14-ae10-321b036a0234 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:13.887219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-457f587c-4db8-4e14-ae10-321b036a0234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:13.958907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:13.986033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:14.136232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:14.137953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:14.163040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:14.291721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21f69-8f35-47f3-934c-a8883eaa1c29 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:14.377048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:14.401710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:14.402772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:14.403053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:14.403319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:14.404909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:14.516309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:14.517888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c650-c76a-42fb-88c8-7fbe81ce25c1 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:14.536341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 721/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:15.425415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede392-4731-49e7-9404-4747138e23fc None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:15.426006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede392-4731-49e7-9404-4747138e23fc None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:15.426006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede392-4731-49e7-9404-4747138e23fc None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:15.427319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:15.432357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af17a6-7521-4efe-b527-666ffb14bf9f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:15.432788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af17a6-7521-4efe-b527-666ffb14bf9f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:15.432889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af17a6-7521-4efe-b527-666ffb14bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:15.508538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-02af17a6-7521-4efe-b527-666ffb14bf9f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:15.509780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-02af17a6-7521-4efe-b527-666ffb14bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:15.552263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:15.608262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:15.764860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede392-4731-49e7-9404-4747138e23fc None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:15.766287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bfede392-4731-49e7-9404-4747138e23fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:15.911991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede392-4731-49e7-9404-4747138e23fc None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:15.967416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:16.025984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:16.026513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:16.026824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:16.027129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:16.028928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:16.118928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:16.120517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89349a-fef3-4f14-ac6e-b57b7c490750 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:16.138911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 715/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:17.016189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:17.016702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:17.016862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:17.018271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:17.023198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836e27-165a-4561-9fdd-cbd255f98c67 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:17.023629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836e27-165a-4561-9fdd-cbd255f98c67 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:17.023763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92836e27-165a-4561-9fdd-cbd255f98c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:17.099516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-92836e27-165a-4561-9fdd-cbd255f98c67 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:17.100718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-92836e27-165a-4561-9fdd-cbd255f98c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:17.102784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:17.200019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:17.353316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:17.354968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:17.500982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12858c1-eaac-45b5-8735-5c23a39b1d59 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:17.526543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:17.619817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:17.620340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:17.620615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:17.621116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:17.623132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:17.716043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:17.717625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de2b9-40e5-486a-9bae-1df446af16f4 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:17.735177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 724/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:19.574805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:19.575415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:19.575415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:19.576700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:19.581824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c954f93-4b78-4e40-aa87-a435c1cbcd6a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:19.582292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c954f93-4b78-4e40-aa87-a435c1cbcd6a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:19.582398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c954f93-4b78-4e40-aa87-a435c1cbcd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:19.623418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:19.648195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2c954f93-4b78-4e40-aa87-a435c1cbcd6a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:19.649441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2c954f93-4b78-4e40-aa87-a435c1cbcd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:19.744980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:20.035358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:20.052662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:20.143606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be763-0484-48c9-8f9a-cd32b492f04a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:20.176494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:20.219108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:20.219627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:20.219923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:20.220195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:20.223046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:20.334659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:20.336138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d06e53-682e-4448-8eb5-5c2e0af2b817 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:20.355766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 718/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:22.446942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:22.447533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:22.447533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:22.449523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:22.454867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c9bd-154f-45fb-9858-b9e3100751c9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:22.455258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c9bd-154f-45fb-9858-b9e3100751c9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:22.455411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c9bd-154f-45fb-9858-b9e3100751c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:22.520650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bf12c9bd-154f-45fb-9858-b9e3100751c9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:22.521848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bf12c9bd-154f-45fb-9858-b9e3100751c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:22.534376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:22.630094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:22.929640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:22.931192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:23.038590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cf01-acfd-4c25-8f65-77ddfc6237b0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:23.051402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:23.112846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:23.113450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:23.113727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:23.113995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:23.115686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:23.223726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:23.225068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8276b62-6836-4a38-a16a-e187f11b26b0 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:23.246880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 727/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:25.528225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:25.528786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:25.528786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:25.530101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:25.535289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1d4b-4d0a-4eeb-ae92-34a277b6ed44 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:25.535737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1d4b-4d0a-4eeb-ae92-34a277b6ed44 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:25.535845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d1d4b-4d0a-4eeb-ae92-34a277b6ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:25.584619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:25.602534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-930d1d4b-4d0a-4eeb-ae92-34a277b6ed44 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:25.603774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-930d1d4b-4d0a-4eeb-ae92-34a277b6ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:25.701357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:57:25.990566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:25.992139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:26.098259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d839b-1ef3-4a1c-9b46-1890b1d97916 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:26.139752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:26.173973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:26.174683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:26.176535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:26.176535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:26.177450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:26.299899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:26.301382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48be5db-9a48-487f-ace3-a17c891f1d23 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:26.319917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 721/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:28.378231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:28.378863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:28.378863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:28.380186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:28.385449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c14c-e963-4ace-b8be-020a54ac0a8b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:28.385863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c14c-e963-4ace-b8be-020a54ac0a8b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:28.385983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c14c-e963-4ace-b8be-020a54ac0a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:28.452119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ddb7c14c-e963-4ace-b8be-020a54ac0a8b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:28.453376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ddb7c14c-e963-4ace-b8be-020a54ac0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:28.473974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:28.549766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:28.833166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:28.834751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:28.938003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b01f6-cefe-4b81-8721-c60714c7fc3b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:28.958274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:29.013919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:29.014524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:29.014836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:29.015113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:29.016722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:29.125674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:29.127047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38e456-4552-4e0a-acbd-4e22380d8873 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:29.145218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 730/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:31.278854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:31.279429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:31.279429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:31.280744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:31.285892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5681-4eae-400b-93ff-38a4c6a3d89a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:31.286301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5681-4eae-400b-93ff-38a4c6a3d89a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:31.286440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5681-4eae-400b-93ff-38a4c6a3d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:31.351352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:31.353927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-73ef5681-4eae-400b-93ff-38a4c6a3d89a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:31.356157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-73ef5681-4eae-400b-93ff-38a4c6a3d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:31.453456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:31.745950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:31.747529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:31.854043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8c32-5da1-47b8-87be-dd669567dcd7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:31.903080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:31.927492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:31.928093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:31.928369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:31.928638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:31.930227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:32.050211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:32.051712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca6622-b1a9-46bd-9da4-328d2a73324c service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:32.071381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 724/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:34.112801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:34.113335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:34.113335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:34.114715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:34.119873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2162-75c7-48ee-a36e-6faed88530c2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:34.120311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2162-75c7-48ee-a36e-6faed88530c2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:34.120501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2162-75c7-48ee-a36e-6faed88530c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:34.187807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-636f2162-75c7-48ee-a36e-6faed88530c2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:34.189033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-636f2162-75c7-48ee-a36e-6faed88530c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:34.217988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:34.286900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:34.575820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:34.577362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:34.683687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959e7c3-db2a-4213-bf90-c6f2c3511944 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:34.711961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:34.758185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:34.758822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:34.759102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:34.759371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:34.761007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:34.873681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:34.875191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ed25-bdfd-48de-bf78-6714d023928a service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:34.895038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 733/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:36.890056 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:36.890639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:36.890639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:36.891981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:36.897143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ba49-2b5d-4b8b-81e9-66fdeb4f2c19 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:36.897546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ba49-2b5d-4b8b-81e9-66fdeb4f2c19 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:36.897680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ba49-2b5d-4b8b-81e9-66fdeb4f2c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:36.963909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4ee8ba49-2b5d-4b8b-81e9-66fdeb4f2c19 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:36.965702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4ee8ba49-2b5d-4b8b-81e9-66fdeb4f2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:36.974035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:37.062262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:37.360466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:37.362076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:37.465600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ce4d-e3c0-4586-87f5-e20a4cf8f96c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:37.520613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:37.537854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:37.538443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:37.538718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:37.539015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:37.540585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:37.661009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:37.662454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a96c-c1e7-46cf-963f-14906c3fe553 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:37.680155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 727/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:39.703503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:39.704081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:39.704212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:39.705627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:39.710752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460556-93d4-4dbf-bc2d-66d13e223cec None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:39.711152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460556-93d4-4dbf-bc2d-66d13e223cec None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:39.711310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460556-93d4-4dbf-bc2d-66d13e223cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:39.779019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-19460556-93d4-4dbf-bc2d-66d13e223cec None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:39.780225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-19460556-93d4-4dbf-bc2d-66d13e223cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:39.818680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:39.879734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:40.172512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:40.173978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:40.285112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a803cb-92e3-45e4-b833-845683159948 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:40.324544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:40.361585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:40.362186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:40.362463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:40.362746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:40.364350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:40.474038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:40.475409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cf2e3-95ac-4a84-86cf-437c25c9ed05 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:40.494104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 736/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:42.453697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:42.454240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:42.454240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:42.455637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:42.460739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585762-823c-4f62-b449-bc2a69d20add None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:42.461153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585762-823c-4f62-b449-bc2a69d20add None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:42.461272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585762-823c-4f62-b449-bc2a69d20add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:42.528020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d5585762-823c-4f62-b449-bc2a69d20add None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:42.529231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d5585762-823c-4f62-b449-bc2a69d20add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:42.546973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:42.624784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:42.911762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:42.913295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:43.020113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae4dc-eabf-4b60-8461-e7a1096630d2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:43.088674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:43.095900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:43.096504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:43.096815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:43.097053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:43.098684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:43.328635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:43.330068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603118fb-31ee-4e0f-9cb5-874327023ac9 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:43.348799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 730/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:45.284057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:45.284587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:45.284587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:45.285992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:57:45.291293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356555cf-2c71-4994-82aa-5f516251c53d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:45.291707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356555cf-2c71-4994-82aa-5f516251c53d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:45.291818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356555cf-2c71-4994-82aa-5f516251c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:45.358013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-356555cf-2c71-4994-82aa-5f516251c53d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:57:45.359236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-356555cf-2c71-4994-82aa-5f516251c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:45.426430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:45.476239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:57:45.758298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:57:45.759921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:45.863476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd0fa7-4dbc-4076-b33d-82a5edc5e8f9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:57:45.911452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:45.939548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:57:45.940162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:57:45.940440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:57:45.940712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:57:45.942307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:57:46.052458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:57:46.053886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ff41-5e4a-48b3-b454-f77b6117f7bb service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:57:46.073856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 739/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:55.474450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=22 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:56.071620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=66 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:06.245999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4eba-4705-4823-baa5-d33eef5dcef6 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:06.245999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4eba-4705-4823-baa5-d33eef5dcef6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:06.245999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4eba-4705-4823-baa5-d33eef5dcef6 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:06.245999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 732/1471] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:06.246880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491aac-7327-46e0-bea3-d45a3a4f80f8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:06.246880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491aac-7327-46e0-bea3-d45a3a4f80f8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:06.246880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491aac-7327-46e0-bea3-d45a3a4f80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:06.313467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-92491aac-7327-46e0-bea3-d45a3a4f80f8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:06.314682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-92491aac-7327-46e0-bea3-d45a3a4f80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:06.417861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 740/1472] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:06.711811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:06.712092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:06.712360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:06.713740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 733/1473] 10.222.0.58 () {54 vars in 967 bytes} [Thu Sep 1 17:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:06.718526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0340f9c-a1b1-4010-9d11-1dbf381293a2 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:06.718881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0340f9c-a1b1-4010-9d11-1dbf381293a2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:06.719159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0340f9c-a1b1-4010-9d11-1dbf381293a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:06.793916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f0340f9c-a1b1-4010-9d11-1dbf381293a2 None None] MFA Rules not processed for user `55c40c8bb3b24e07b3189f84acd4ca02`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:06.795176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f0340f9c-a1b1-4010-9d11-1dbf381293a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:06.816086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:06.871492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 741/1474] 10.222.0.58 () {58 vars in 1064 bytes} [Thu Sep 1 17:58:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:06.879033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:06.880474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:06.984809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac58e6-aa93-44ee-97c9-97df2d71f17f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:07.058028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:07.058607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:07.058921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:07.059189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:07.060779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:07.113501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:07.169847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:07.171241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f030-067d-4ac3-85ec-a97b08b0ad55 service glance] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:07.191004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 734/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:09.223198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:09.223722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:09.223722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:09.225040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 742/1476] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:09.231168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea26d1-eb5b-49ab-bcc0-247d40211152 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:09.231625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea26d1-eb5b-49ab-bcc0-247d40211152 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:09.231733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea26d1-eb5b-49ab-bcc0-247d40211152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:09.308144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-41ea26d1-eb5b-49ab-bcc0-247d40211152 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:09.309389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-41ea26d1-eb5b-49ab-bcc0-247d40211152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:09.410206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 735/1477] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:09.686889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:09.688429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:09.814280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d579a-b2a4-4ef9-a175-c8c800dc1291 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:09.865495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:09.910484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:09.911108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:09.911385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:09.911701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:09.912282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:09.913995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:58:09.913995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 17:58:09.913995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 17:58:09.915222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3860c-1021-405f-a47f-b6bf365870da admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:09.936414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 743/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Thu Sep 1 17:58:09 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:58:11.899317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:11.899853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:11.899853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:11.902036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 736/1479] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:11.907307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd45c8-12a0-4665-ba48-c07950a1560c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:11.907752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd45c8-12a0-4665-ba48-c07950a1560c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:11.907863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd45c8-12a0-4665-ba48-c07950a1560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:11.974018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c5dd45c8-12a0-4665-ba48-c07950a1560c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:11.975259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c5dd45c8-12a0-4665-ba48-c07950a1560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:12.075949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 744/1480] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:12.368685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:12.370260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:12.380224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:12.520490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b536-58d7-4122-8654-f8911ac676a2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:12.600985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:12.641133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:12.641637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:12.641911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:12.642206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:12.643828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:12.733377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:12.735001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ec30e-792a-4b98-84b1-e0285f8e21c0 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:12.752471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 737/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:14.880762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:14.881312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:14.881312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:14.882665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 745/1482] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:14.888804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b23bc-6418-487b-9538-50fc0ae58dff None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:14.889264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b23bc-6418-487b-9538-50fc0ae58dff None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:14.889377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b23bc-6418-487b-9538-50fc0ae58dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:14.957519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c58b23bc-6418-487b-9538-50fc0ae58dff None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:14.958755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c58b23bc-6418-487b-9538-50fc0ae58dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:15.004083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:15.054068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 738/1483] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:15.340413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:15.341958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:15.365397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:15.444868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0202d-9942-4339-8edf-3221313fe541 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:15.517462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:15.518077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:15.518355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:15.518625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:15.520262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:15.594977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:15.628988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:15.630424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c655-425c-4799-9484-f16761cc2b3f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:15.649092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 746/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:17.630771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:17.631334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:17.631334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:17.632676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 739/1485] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:17.638674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1faa-5e68-41c1-b999-146a6661530f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:17.639099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1faa-5e68-41c1-b999-146a6661530f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:17.639266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d1faa-5e68-41c1-b999-146a6661530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:17.706775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d20d1faa-5e68-41c1-b999-146a6661530f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:17.707984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d20d1faa-5e68-41c1-b999-146a6661530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:17.803562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 747/1486] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:18.092299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:18.093860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:18.206357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96e8d4-1c6f-41ce-b1ff-fec10da3fd9c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:18.278984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:18.280863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:18.281476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:18.281752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:18.282022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:18.283728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:18.394404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:18.395891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fc815-3559-4c06-9b2f-cac535143dcc service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:18.416757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 740/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:20.469619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:20.470285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:20.470285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:20.471535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 748/1488] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:20.476667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a38c-05b1-4e80-8839-aab330f4afde None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:20.477100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a38c-05b1-4e80-8839-aab330f4afde None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:20.477204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a38c-05b1-4e80-8839-aab330f4afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:20.548606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9624a38c-05b1-4e80-8839-aab330f4afde None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:20.549831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9624a38c-05b1-4e80-8839-aab330f4afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:20.603295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:20.647367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 741/1489] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:58:20.945988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:20.948429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:20.986408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:21.052623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386250-4bc4-4c20-9310-2fb30316d277 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:21.131175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:21.131786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:21.132065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:21.132333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:21.133937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:21.216693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:21.249371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:21.250820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9753ae3-f20a-48a2-9f17-c45cbe9a80d8 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:21.269325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 749/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:23.528961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:23.529539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:23.529539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:23.530872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 742/1491] 10.222.0.58 () {54 vars in 927 bytes} [Thu Sep 1 17:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:58:23.535988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969251-3c17-49a8-8ba0-aca905f5ecc8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:23.536441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969251-3c17-49a8-8ba0-aca905f5ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:23.536553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f969251-3c17-49a8-8ba0-aca905f5ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:23.602751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6f969251-3c17-49a8-8ba0-aca905f5ecc8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:58:23.603972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6f969251-3c17-49a8-8ba0-aca905f5ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:23.699720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 750/1492] 10.222.0.58 () {58 vars in 1024 bytes} [Thu Sep 1 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:58:23.992343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:58:23.993912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:24.098473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126779b-bdf5-4693-96a1-920475ce3c5a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:58:24.178660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:58:24.179318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:58:24.179631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:58:24.179933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:58:24.181542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:58:24.191461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:24.292719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:58:24.294160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84582749-92c9-4b7f-aad5-3da9521043f6 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:58:24.312027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 743/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:58:33.697194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=82 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:34.309770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=50 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:58.004542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:58.005063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:58.005171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:58.081997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:59:58.083256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:58.179753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 751/1494] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:59:58.189258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:58.189820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:58.189820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:58.270337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:59:58.271657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:58.369733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 744/1495] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:59:58.374413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:58.375666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:58.387094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d4eb2-f033-4c2e-a14f-ce6d44593fa3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:58.448104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:58.481186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:58.482418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:58.482698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:58.483009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:58.483653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:59:58.483957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:58.485311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:58.485311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 17:59:58.485311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 17:59:58.486206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:58.497854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 752/1496] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 17:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:59:58.506029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:58.515299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84e23-925f-4be5-98e8-68915a54f664 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:58.582042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:58.615935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:58.616535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:58.616813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:58.617081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:58.617701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:58.619489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:58.619489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 17:59:58.619489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 17:59:58.620681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:58.768210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 745/1497] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 17:59:58 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:59:58.772509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:58.774083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:58.809354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51ee24-51bf-42c1-9423-490ec8aa3843 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:58.904912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:58.905431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:58.905710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:58.905979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:58.906616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:58.907656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:58.907656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 17:59:58.907656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 17:59:58.908876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:59.019311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 753/1498] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 17:59:58 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:59:59.023634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:59.025175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:59.086951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ff6e-b9da-4648-81e5-261d5df7a1ae admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:59.169369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:59.179550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:59.180184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.180462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.180730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.181372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:59.182381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:59.182381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 17:59:59.182381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 17:59:59.183306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:59.195976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 746/1499] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 17:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:59:59.200966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:59.202508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:59.219109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3739736-e7cf-461c-8e20-089fe907fc3c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:59.246590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:59.317038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:59.317713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.317996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.318269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.318942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:59.319993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:59.319993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 17:59:59.319993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 17:59:59.321088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a626f-3514-4c2e-8a36-4ee1dfb31388 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:59.339132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 754/1500] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 17:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:59:59.343840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:59.345376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:59.380274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c9e6c-d6e3-4bb3-a562-c683e71ad03e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:59:59.475600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:59:59.476299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.476574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.476848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] PATH_INFO: `/v3/projects/d2b2770898e8417db2c5942904c2798a/users/74915924a5ca4410aa6733572637345e/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.501295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b2770898e8417db2c5942904c2798a, user_id=74915924a5ca4410aa6733572637345e, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:59:59.502334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:59:59.502334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 17:59:59.502334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 17:59:59.504426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ee086-8326-478d-aead-237d00989f3c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:59:59.586358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 747/1501] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 17:59:59 2022] PUT /identity/v3/projects/d2b2770898e8417db2c5942904c2798a/users/74915924a5ca4410aa6733572637345e/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:59:59.598578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e5fd-542d-4f9b-8e22-2bc884ffb974 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.599455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e5fd-542d-4f9b-8e22-2bc884ffb974 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.599455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1e5fd-542d-4f9b-8e22-2bc884ffb974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.658288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-02b1e5fd-542d-4f9b-8e22-2bc884ffb974 None None] MFA Rules not processed for user `74915924a5ca4410aa6733572637345e`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:59:59.659546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-02b1e5fd-542d-4f9b-8e22-2bc884ffb974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:59.752272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 755/1502] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:59:59.766227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.766508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.766812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.768267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 748/1503] 10.222.0.58 () {54 vars in 964 bytes} [Thu Sep 1 17:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:59:59.773286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248565-b810-4522-b922-93b4555fcae5 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:59:59.773574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248565-b810-4522-b922-93b4555fcae5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:59:59.773872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248565-b810-4522-b922-93b4555fcae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:59:59.805646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:59:59.851642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-82248565-b810-4522-b922-93b4555fcae5 None None] MFA Rules not processed for user `e162ed7a337a40f5875048254f16a2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:59:59.852981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-82248565-b810-4522-b922-93b4555fcae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:59:59.956686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 756/1504] 10.222.0.58 () {58 vars in 1061 bytes} [Thu Sep 1 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:59:59.966931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:59:59.968719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:00.030023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:00.090596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e221f-abf3-4f13-8873-485afb6d9887 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:00:00.177810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:00:00.178771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:00.179050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:00.179319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:00.181477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:00.299363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:00:00.300729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:00:00.304305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:00.319638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 749/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 17:59:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:00:00.369897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5658e-6e0c-4804-a87c-977cc74d620f None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:00.370486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5658e-6e0c-4804-a87c-977cc74d620f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:00.370685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5658e-6e0c-4804-a87c-977cc74d620f None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:00.371959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 757/1506] 10.222.0.58 () {52 vars in 830 bytes} [Thu Sep 1 18:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 18:00:00.376784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:00:00.378272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:00.514341 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89ccf-9d7d-4fce-9877-71dc62a6c656 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:00:00.636007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:00:00.636923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:00.637439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:00.638305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] PATH_INFO: `/v3/users/74915924a5ca4410aa6733572637345e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:00.651121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74915924a5ca4410aa6733572637345e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:00:00.652163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:00:00.652163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 18:00:00.652163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 18:00:00.653493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:00:00.666467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:00.936224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74915924a5ca4410aa6733572637345e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:00.952196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74915924a5ca4410aa6733572637345e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:01.039531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74915924a5ca4410aa6733572637345e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:01.039978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74915924a5ca4410aa6733572637345e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:01.065052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74915924a5ca4410aa6733572637345e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:01.070782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 750/1507] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:00:00 2022] DELETE /identity/v3/users/74915924a5ca4410aa6733572637345e => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:00:01.075457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:01.075844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:01.076126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:01.132603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:00:01.133808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:01.208229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:01.224591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 758/1508] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:00:01.235165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:00:01.236390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:01.354400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5c61-5256-41c1-b12b-ee1f373e2c5b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:00:01.413101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:01.431940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:00:01.436430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:01.436430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:01.436430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:01.436430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:01.542125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:00:01.543598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9cc2e-f01b-46c1-8929-b5d5983f2884 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:00:01.562067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 751/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:00:02.048576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:00:02.049042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:00:02.061044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b284-664c-4075-886b-a1e8599858f4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:00:02.161111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:00:02.161738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:00:02.162012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:00:02.162278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] PATH_INFO: `/v3/projects/d2b2770898e8417db2c5942904c2798a` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:00:02.172315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b2770898e8417db2c5942904c2798a)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:00:02.173326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:00:02.173326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 18:00:02.173326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 18:00:02.174511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:00:02.331689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b2770898e8417db2c5942904c2798a', 'request_id': 'req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:02.337883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b2770898e8417db2c5942904c2798a', 'request_id': 'req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:02.423538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b2770898e8417db2c5942904c2798a', 'request_id': 'req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:02.454414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] The token cache is being invalidate because project d2b2770898e8417db2c5942904c2798a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:00:02.454707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:02.455162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f99e2504-ba8d-4a50-88f5-5f5acf09ab26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:00:02.456632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 759/1510] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:00:02 2022] DELETE /identity/v3/projects/d2b2770898e8417db2c5942904c2798a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:00:11.559974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=62 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:00:12.452249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:01:37.219355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debd42-142c-4244-b84e-1b247af43339 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:37.219872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debd42-142c-4244-b84e-1b247af43339 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:37.219872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41debd42-142c-4244-b84e-1b247af43339 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:37.222066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 18:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:37.227185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932352-366a-4837-a72b-3f51df1dd03a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:37.227663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932352-366a-4837-a72b-3f51df1dd03a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:37.227772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932352-366a-4837-a72b-3f51df1dd03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:37.310461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-29932352-366a-4837-a72b-3f51df1dd03a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:37.311698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-29932352-366a-4837-a72b-3f51df1dd03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:37.415757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:37.571738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41debd42-142c-4244-b84e-1b247af43339 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:37.580278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-41debd42-142c-4244-b84e-1b247af43339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:37.693569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41debd42-142c-4244-b84e-1b247af43339 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:37.699406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:37.700011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:37.700290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:37.700590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:37.709852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:37.711483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb6b92-7f21-4815-a226-0d002e4f7dec service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:37.720866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 753/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:01:38.585943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b718-8492-44f9-9b67-b7000af2eb3b None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:38.586505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b718-8492-44f9-9b67-b7000af2eb3b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:38.586505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b718-8492-44f9-9b67-b7000af2eb3b None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:38.587895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 18:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:38.592627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e197-f5fa-47fe-bbc7-277d1308b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:38.593055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e197-f5fa-47fe-bbc7-277d1308b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:38.593175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e197-f5fa-47fe-bbc7-277d1308b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:38.614292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7ab2e197-f5fa-47fe-bbc7-277d1308b0d0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:38.615534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7ab2e197-f5fa-47fe-bbc7-277d1308b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:38.623495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 18:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:38.781599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b718-8492-44f9-9b67-b7000af2eb3b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:38.795796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b718-8492-44f9-9b67-b7000af2eb3b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:38.801294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:38.801892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:38.802166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:38.802430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:38.810721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:38.812323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3084dd-9e2d-4d57-abea-08b87d3a2518 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:38.822563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 762/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:01:39.162187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c8f5-58f4-45e5-9973-b8facc8ceafc None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:39.162400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c8f5-58f4-45e5-9973-b8facc8ceafc None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:39.162652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c8f5-58f4-45e5-9973-b8facc8ceafc None None] PATH_INFO: `/v3` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:39.163942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 755/1517] 10.222.0.18 () {54 vars in 925 bytes} [Thu Sep 1 18:01:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:01:39.191103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066d44-b581-4baa-9b91-c55c65626c0f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:39.191381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066d44-b581-4baa-9b91-c55c65626c0f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:39.191651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c066d44-b581-4baa-9b91-c55c65626c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:39.249668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6c066d44-b581-4baa-9b91-c55c65626c0f None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:39.250897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6c066d44-b581-4baa-9b91-c55c65626c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:39.268037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:01:39.323578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 763/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 1 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:43.409476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeaeae-c68f-4d94-a31e-c2bb9ea11c23 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:43.409476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeaeae-c68f-4d94-a31e-c2bb9ea11c23 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:43.410473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeaeae-c68f-4d94-a31e-c2bb9ea11c23 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:43.411311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 756/1519] 10.222.0.58 () {54 vars in 961 bytes} [Thu Sep 1 18:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:43.416448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bae9-8fdc-4ba1-93fe-d3a4c001dbff None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:43.416866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bae9-8fdc-4ba1-93fe-d3a4c001dbff None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:43.417033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bae9-8fdc-4ba1-93fe-d3a4c001dbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:43.436414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c983bae9-8fdc-4ba1-93fe-d3a4c001dbff None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:43.437603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c983bae9-8fdc-4ba1-93fe-d3a4c001dbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:43.446870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 764/1520] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Sep 1 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:43.454499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeaeae-c68f-4d94-a31e-c2bb9ea11c23 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:43.468511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeaeae-c68f-4d94-a31e-c2bb9ea11c23 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:43.473561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:43.474142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:43.474421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:43.474696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:43.482938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:43.484561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53636f46-b402-44c4-8f07-75e4b1cef8ff service placement] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:43.494155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 757/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:01:50.074850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ffc1a-21bc-4081-895c-3f16ff8f01bd None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:50.075345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ffc1a-21bc-4081-895c-3f16ff8f01bd None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:50.075475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ffc1a-21bc-4081-895c-3f16ff8f01bd None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:50.076868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 18:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:50.081750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e025ad-e446-438e-b476-4afe54269744 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:50.082362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e025ad-e446-438e-b476-4afe54269744 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:50.082362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e025ad-e446-438e-b476-4afe54269744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:50.102161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a5e025ad-e446-438e-b476-4afe54269744 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:50.103400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5e025ad-e446-438e-b476-4afe54269744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:50.111305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:50.273960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ffc1a-21bc-4081-895c-3f16ff8f01bd None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:50.289813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ffc1a-21bc-4081-895c-3f16ff8f01bd None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:50.295462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:50.296044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:50.296318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:50.296583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:50.304899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:50.306404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30105e0-8c53-4a42-a5e4-407189c58909 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:50.316203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 766/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:01:51.156055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe3e7-25bb-464f-b277-aa8d7c6e837d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:51.156618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe3e7-25bb-464f-b277-aa8d7c6e837d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:51.156618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe3e7-25bb-464f-b277-aa8d7c6e837d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:51.157959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 18:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:51.162911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df721c-ae0a-4ff5-8f1c-78027ac9f7d6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:51.163299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df721c-ae0a-4ff5-8f1c-78027ac9f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:51.163458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df721c-ae0a-4ff5-8f1c-78027ac9f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:51.183526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-08df721c-ae0a-4ff5-8f1c-78027ac9f7d6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:51.184717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-08df721c-ae0a-4ff5-8f1c-78027ac9f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:51.192464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 18:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:01:51.342009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe3e7-25bb-464f-b277-aa8d7c6e837d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:51.357178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe3e7-25bb-464f-b277-aa8d7c6e837d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:51.362664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:51.363284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:51.363558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:51.363830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:51.373015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:51.374919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cf8cb-6a60-40ec-ab91-f46adedc2f2a service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:51.385078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 760/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:01:55.474241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:55.474930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:55.474930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:55.476964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 18:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:55.482140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c956e-47c7-4c39-a442-583e050e0a4f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:55.482596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c956e-47c7-4c39-a442-583e050e0a4f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:55.482703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c956e-47c7-4c39-a442-583e050e0a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:55.502137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0e2c956e-47c7-4c39-a442-583e050e0a4f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:55.503351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0e2c956e-47c7-4c39-a442-583e050e0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:55.511220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 18:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:55.800201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:55.801895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:55.880254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e63ded-51bf-4698-a5fc-fb7903ef6b28 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:55.884633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:55.885233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:55.885510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:55.885778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:55.894572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:55.896021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a6e8-d6e0-40a2-bf68-cc3bf3c44b9a service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:55.906490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 769/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:01:57.879929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:57.880444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:57.880444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:57.882361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 18:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:01:57.887503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bce7e-bddb-4d91-98b5-82ec3c8bcdc6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:57.887973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bce7e-bddb-4d91-98b5-82ec3c8bcdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:57.888080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bce7e-bddb-4d91-98b5-82ec3c8bcdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:57.908029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-546bce7e-bddb-4d91-98b5-82ec3c8bcdc6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:01:57.909249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-546bce7e-bddb-4d91-98b5-82ec3c8bcdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:57.918068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 18:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:01:58.213697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:01:58.215385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:01:58.228508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659b67d-2491-4a7a-a2b1-ffbfd001110e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:01:58.232876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:01:58.232876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:01:58.233185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:01:58.233185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:01:58.242180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:01:58.243704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b59703-7867-4c87-9c74-4296215bbc12 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:01:58.253220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 763/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:02:01.675614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:01.676187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:01.676187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:01.677495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 18:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 18:02:01.683636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79bf2-26ae-4d6c-9b7b-262c40c97fa0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:01.684066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79bf2-26ae-4d6c-9b7b-262c40c97fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:01.684324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79bf2-26ae-4d6c-9b7b-262c40c97fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:01.692050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=81 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:01.705715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ceb79bf2-26ae-4d6c-9b7b-262c40c97fa0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:02:01.708037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ceb79bf2-26ae-4d6c-9b7b-262c40c97fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:02:01.714867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:02:02.358374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:02:02.360720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:02:02.464423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:02.482840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0712268-2730-46a8-ba65-51ab834fae8d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:02:02.488179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:02:02.488792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:02.489064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:02.489327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:02.500966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:02:02.503513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2d7a1-f2dd-4210-939b-7883ec977393 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:02:02.515469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 772/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:02:04.491280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:04.491854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:04.491854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:04.493146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 18:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:02:04.498201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c2be-131b-46bc-8a65-b3c58ba45202 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:04.498601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c2be-131b-46bc-8a65-b3c58ba45202 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:04.498773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c2be-131b-46bc-8a65-b3c58ba45202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:04.518086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-7bf8c2be-131b-46bc-8a65-b3c58ba45202 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:02:04.519324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7bf8c2be-131b-46bc-8a65-b3c58ba45202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:02:04.528073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 18:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:02:05.083660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:02:05.086202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:02:05.099184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484799db-cdf1-4628-8aa6-c974aa51fbb2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:02:05.102769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:02:05.103354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:02:05.103628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:02:05.103897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:02:05.112751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:02:05.114204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0931b21-b221-4623-a959-0dfaddb3bfc6 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:02:05.127855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 766/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:02:14.513217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=11 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:15.123506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=8 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:33.204884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5169-16bd-4896-a7ca-5257446d0d1b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.206213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5169-16bd-4896-a7ca-5257446d0d1b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.206802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a5169-16bd-4896-a7ca-5257446d0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.240115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-314a5169-16bd-4896-a7ca-5257446d0d1b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.241727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-314a5169-16bd-4896-a7ca-5257446d0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.256664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 774/1540] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.265796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.266915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.266915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.303939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.305177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.314264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.314997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.315499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.317743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 767/1541] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.324002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.334202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d9f37-a9a5-474f-b15a-37f2cc76e79e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.344026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.344663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.344941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.345216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.345871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:33.346170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.347216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:33.347216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 18:03:33.347216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 18:03:33.348175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdd69-5609-4cfa-9997-6a7b40166f1c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.354311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.356105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.371285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 768/1542] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:33.372924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 775/1543] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.389011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.389236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.389463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.389640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.406506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd317b-7960-4f5d-964d-7671d4ed521c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.418499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.419409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.419864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.420302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.421110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.422301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:33.422301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 18:03:33.422301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 18:03:33.423740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.424057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4646-bf37-4e92-bf5d-5410cf1a76f6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.424967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.454820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 769/1544] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.464663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.474085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fd9c2-f9cf-47e7-962b-d4f30404b9a0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.487451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.488092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.488372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.488645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.489304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:33.489609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.491365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.509478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 770/1545] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:33.517977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.534494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a76ae4-5bb3-4931-820f-12a3f13d6832 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.539947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.540559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.540834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.541777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.542864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.544804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aab8ee-2746-4d29-9c0c-fdb059744791 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.617819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 776/1546] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:33.619175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de441-3036-4c38-ad8d-a013c1b34a8b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.619616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de441-3036-4c38-ad8d-a013c1b34a8b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.620004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869de441-3036-4c38-ad8d-a013c1b34a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.640370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-869de441-3036-4c38-ad8d-a013c1b34a8b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.641707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-869de441-3036-4c38-ad8d-a013c1b34a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.675086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 771/1547] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:33.676422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15d8f-cc45-4ad2-b7f6-dee33e20cdf7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.676714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15d8f-cc45-4ad2-b7f6-dee33e20cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.677010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15d8f-cc45-4ad2-b7f6-dee33e20cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.696803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1ee15d8f-cc45-4ad2-b7f6-dee33e20cdf7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.705934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1ee15d8f-cc45-4ad2-b7f6-dee33e20cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.706098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 777/1548] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.706098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7c0e-2962-40b0-947a-1d4be2cdc19a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.706098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7c0e-2962-40b0-947a-1d4be2cdc19a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.706098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7c0e-2962-40b0-947a-1d4be2cdc19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.726051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-652e7c0e-2962-40b0-947a-1d4be2cdc19a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.729387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-652e7c0e-2962-40b0-947a-1d4be2cdc19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.768745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 772/1549] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.768745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.768745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.768745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.785334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.786571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.791904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 778/1550] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.793413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09718cc-874f-4e05-ad53-392510eb9aef None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.793706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09718cc-874f-4e05-ad53-392510eb9aef None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.793975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09718cc-874f-4e05-ad53-392510eb9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.798867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 773/1551] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.798867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.810159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e8f1-d7e4-4411-bd3d-f9a8c27c547c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.814835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e09718cc-874f-4e05-ad53-392510eb9aef None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.814959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.815316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.815595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.815815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e09718cc-874f-4e05-ad53-392510eb9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.815936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.816477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.817480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:33.817480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 18:03:33.817480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 18:03:33.818672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09459fa-d055-4b92-8b83-2ea818901492 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.824883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 779/1552] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.826141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.826424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.826695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.849594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.849594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.855137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 780/1553] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.856023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:33.865377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672aa8-0c40-4c4e-9ed2-e23ebe389618 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:33.870904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:33.871485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.871766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.872038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.872664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:33.874570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7623a-abc9-4801-a781-702f0f0eacad admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:33.914555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 774/1554] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:33.916407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2cc06-253b-43f3-9083-989c87ae768b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.916824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2cc06-253b-43f3-9083-989c87ae768b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.917282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2cc06-253b-43f3-9083-989c87ae768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.941245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-36d2cc06-253b-43f3-9083-989c87ae768b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.942453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-36d2cc06-253b-43f3-9083-989c87ae768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.951475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 775/1555] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.952647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96026-4653-47b6-b9ec-0d5a36965575 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.952971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96026-4653-47b6-b9ec-0d5a36965575 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.953225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96026-4653-47b6-b9ec-0d5a36965575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.972813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2bb96026-4653-47b6-b9ec-0d5a36965575 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:33.974003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2bb96026-4653-47b6-b9ec-0d5a36965575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:33.982534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 776/1556] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:33.983753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fac83-672a-44ce-a644-69e928a9cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.984033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fac83-672a-44ce-a644-69e928a9cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.984305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fac83-672a-44ce-a644-69e928a9cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:33.998214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 781/1557] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:33.998214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3fc9-a706-48da-8ce7-eb94796fff41 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:33.998214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3fc9-a706-48da-8ce7-eb94796fff41 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:33.998214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3fc9-a706-48da-8ce7-eb94796fff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.005592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ce0fac83-672a-44ce-a644-69e928a9cbf0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:34.006824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ce0fac83-672a-44ce-a644-69e928a9cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:34.015116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 777/1558] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:34.016613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.016894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.017112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-883b3fc9-a706-48da-8ce7-eb94796fff41 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:34.017239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.018320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-883b3fc9-a706-48da-8ce7-eb94796fff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:34.027533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 782/1559] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:34.028755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.029045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.029318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.037014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:34.038222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:34.046786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 778/1560] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:34.048206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.050656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:34.051892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:34.058195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bda9c9-e40a-4d49-a639-c7501cb13a4e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.060560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 783/1561] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:34.061468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.065182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.065827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.066385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.066660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.067896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.069525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.070854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e37fd-3f94-4073-ac2c-d662113d850e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.076196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.076826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.077101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.077373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.078108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.078433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.080059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.080580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 779/1562] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:34.081248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.089324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:34.090844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d628ba-9382-4a10-aa78-cbfe42c6ae77 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.092915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 784/1563] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.093713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.100732 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.102387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.102387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.102387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.102658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.102842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.104978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.108007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d204cc2-2522-454f-86c0-e9fb3f51ab1e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.112582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.113242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.113519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.113786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.114419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.116032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.117311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 780/1564] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.117977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.128311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2aa4-ddd3-4342-8fdb-e03b4ae68cc9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.132935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.133167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 785/1565] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:34.133806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.134088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.134186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.134359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.135096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.135391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.137240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.145842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34e636-9eba-4f30-bbdd-7d1f28015105 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.149143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 781/1566] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.150026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.156399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.157006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.157284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.157549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.158194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.158498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.160131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.161013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bfa16-4f6a-499b-8601-8c4f577e9560 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.165734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.166958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.167421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.167740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.168391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.168697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.170315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.172539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 786/1567] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.175716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.178065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:34.184221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 782/1568] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.186506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.186947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e82dcd-238b-4abd-bbef-779521f11ee6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.191842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.192445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.192758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.193043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.193692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:34.194059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.195615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.199693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1806a-4875-49df-8c2d-7c00bc050726 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.204390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.205029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.205304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.205574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.206215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.207829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.214193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 787/1569] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:34.214193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.219099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3714a14-a915-450e-bfd5-796a7a6ef6ed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.223797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.224163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 783/1570] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:34.224394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.224697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.224905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.225013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.225546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.227735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.235764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c532-7840-4b02-bd8e-098b7d68ce46 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.240441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.241035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.241317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.241593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.242218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.244769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.316527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 788/1571] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.317357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.345829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 784/1572] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.347373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.380788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf084-44a1-4979-a563-878730debf14 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.409663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa31-578e-4402-bb42-f123f3ab0591 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.414427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.415059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.415338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.415609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.416798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.418711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.437145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.437753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.438034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.438305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.439008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.440782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.450877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 789/1573] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:34.451794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.461209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7c48d-e973-4fe3-bcb2-f066b48cc5a8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.466510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.467097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.467380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.467652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.468264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.470125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.492971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 785/1574] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.493786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.544820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 790/1575] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.545552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.555424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ff595-da24-46a0-9d90-79b317711257 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.575477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:34.608856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:34.614140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114416-6b0f-4d49-8179-de5b26db7c56 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.614754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.615367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.615659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.615979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.616551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.618456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.619746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.623230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.623230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.623230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.623230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.623591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.697978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 786/1576] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.698874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.721070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 791/1577] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.721070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.761627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930431cd-2346-488f-ad17-b0b0763a45f1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.785235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9d794-74f5-42b4-95aa-8acff80a2f38 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.789968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.790618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.795223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.795223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.795223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.795223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.821765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.823061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.823337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.823606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] PATH_INFO: `/v3/projects/3f6c5131dd1749c5a39e0225a02c8304/users/2fbe773070f049d184b593600390f396/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.838424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6c5131dd1749c5a39e0225a02c8304, user_id=2fbe773070f049d184b593600390f396, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.841106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.876126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 792/1578] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:34.876935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:34.887339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7e426-9191-4eae-99c1-272e894bf36d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:34.892124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:34.892708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:34.892985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:34.893258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:34.893875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:34.895862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:34.943611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 787/1579] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:34 2022] PUT /identity/v3/projects/3f6c5131dd1749c5a39e0225a02c8304/users/2fbe773070f049d184b593600390f396/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:34.944461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.008488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff210e00-aa79-49ff-834c-696d00c87cef admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.012025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 793/1580] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:34 2022] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.020739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.020889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.020889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.020889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.020889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] PATH_INFO: `/v3/projects/54ab2e6750c04628b467daea0ea08e37/users/93a6ff3696014b9eb0ce7eab09922e8e/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.024605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522c315-9b0f-495d-84f4-71016c0bcb66 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.029631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.030292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.030575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.030889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.031568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.032901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab2e6750c04628b467daea0ea08e37, user_id=93a6ff3696014b9eb0ce7eab09922e8e, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.033543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.035604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.038805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:35.148871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 788/1581] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:34 2022] PUT /identity/v3/projects/54ab2e6750c04628b467daea0ea08e37/users/93a6ff3696014b9eb0ce7eab09922e8e/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:35.149607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.153386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 794/1582] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.154259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.164395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0f5a-0568-4dc7-bb5e-14edc4fbfad7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.223277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f46e2f-3cd1-484e-898f-9ca8b4215bfb admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.226405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.227058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.227333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.227605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.228236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.231883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.232024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.232024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.232206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.232372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.232998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.236105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.240629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:35.347662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 795/1583] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.347991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 789/1584] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.348561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.349534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.360260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff462-10b7-43a3-a06d-411df0d36414 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.361157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56794553-c207-4cc4-b4a6-b06df4a2e8f6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.364969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.365556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.365725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.365845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.366086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.366309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.366589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.366762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.366900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.367552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.368454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a8497-8bf4-461f-b2da-0793933f9ab9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.369457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.378601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 790/1585] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.380187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.380660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.380804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.409714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] MFA Rules not processed for user `2fbe773070f049d184b593600390f396`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:35.410938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:35.440516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 796/1586] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.441371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.451998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaafbb6-cd78-44a0-9b3f-9f13d8184875 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.456716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.457309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.457586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.457853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.458546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.460150 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1dfee-036f-4d27-933b-677ab1cb017b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.474670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 797/1587] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.474670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.474670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.474670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.481937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 791/1588] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:35.482832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.492772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd538b-e2f9-42f9-a183-30a869c466a9 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.493459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:35.494717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:35.497541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.498122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.498394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.498658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.499404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.501331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.502666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 798/1589] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:35.503857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.512127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 792/1590] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.512946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.517136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31449c25-7176-4cd0-bb7b-ee2c4dd9206d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.521900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.522504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.522825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.523095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.523737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.524593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c352-e188-4b43-99d9-a20eb45f246d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.525390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.530400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.531011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.531292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.531556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.532186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.533758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.536379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 799/1591] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.537209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.547413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9900de-d5ef-47e5-9981-82e723f53c01 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.548561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 793/1592] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.549373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.552779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.553497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.553882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.554264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.555046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.556740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.559185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34619809-1b06-4f3c-87ad-e5956d71af1a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.563670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.564258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.564537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.564808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.565444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.567084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.567187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 800/1593] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.567885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.578375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1e3a-1658-443f-9dbb-2b027e300708 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.579250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 794/1594] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.580228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.583189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.583777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.584059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.584340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.584976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.586557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.590872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dbe7c-e685-4c02-9d49-6ea1894ceb68 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.595572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.596160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.596441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.596711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.597331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.599256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.599398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 801/1595] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.600128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.656874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41a16a-fa71-4988-86d7-7f1c97348207 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.660690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.661232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.661533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.661803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.670840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.672283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.681956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 802/1596] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:35.689946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.690191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 795/1597] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:35.690191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.692317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc31e-0bb0-4ca4-a3b7-c51433740e19 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.702522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:35.751314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.751916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.752189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.752457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.753089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.754665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.755505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466991-018f-48ae-a27c-afa337a5a33d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.762123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.762967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.767269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.767269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.767269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.767533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 803/1598] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.767630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.767724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.776598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63eb8-ecfe-4204-b582-5b7db5a7227d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.776786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 796/1599] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.777572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.783767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.784456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.784735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.785007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.785653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.787339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.787469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc07da5-cc4d-4118-bed0-832ed3f48b4c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.792298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.792945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.793229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.793500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] PATH_INFO: `/v3/projects/99cf65aa3bd348cebc6562961c1b6f7c/users/b870b5ae143c4104ab02446b0740bc42/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.799384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 804/1600] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.800225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.811348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ca9e2-e878-4135-9c10-497ceccb60fd admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.813490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cf65aa3bd348cebc6562961c1b6f7c, user_id=b870b5ae143c4104ab02446b0740bc42, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.816350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.816497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.816992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.817272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.817544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.818179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.820364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.827071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:35.832820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 805/1601] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:35.833655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.844305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500da45-a7d8-4575-9895-f5595948c5c2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:35.850779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:35.850779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:35.850779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:35.850779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] PATH_INFO: `/v3/projects/65d0be9d64aa473f846619ccc323e06b/users/f27cb77779854919af18462926645090/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:35.865452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d0be9d64aa473f846619ccc323e06b, user_id=f27cb77779854919af18462926645090, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:35.866568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:35.866568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 18:03:35.866568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 18:03:35.868832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:35.896176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 797/1602] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:35 2022] PUT /identity/v3/projects/99cf65aa3bd348cebc6562961c1b6f7c/users/b870b5ae143c4104ab02446b0740bc42/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:35.901542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.963757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 806/1603] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:35 2022] PUT /identity/v3/projects/65d0be9d64aa473f846619ccc323e06b/users/f27cb77779854919af18462926645090/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:35.964954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:35.966852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3fa2-f81a-4605-8b0a-9431662f3f91 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.040730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.041696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.042074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.042461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.043223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.045577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.050409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2d34-5ca7-4a7e-b762-0189cafdb0ed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.055500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.061129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.061129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.061129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] PATH_INFO: `/v3/projects/b9ee11ed7be14e40a17d8eed0628a1e6/users/6857802102bb4b278ebf3085b6917142/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.074282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ee11ed7be14e40a17d8eed0628a1e6, user_id=6857802102bb4b278ebf3085b6917142, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.080145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.142404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 798/1604] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:35 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:36.143257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.153139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51042ea-64bf-437c-aa17-092d62696a53 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.157834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.158520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.158829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.159120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] PATH_INFO: `/v3/projects/8dbb3453986b4203a632cbdbbb15c6a5/users/eddd8e1656254bb0b75d0cc7e5c12b42/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.172692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 807/1605] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:35 2022] PUT /identity/v3/projects/b9ee11ed7be14e40a17d8eed0628a1e6/users/6857802102bb4b278ebf3085b6917142/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:36.172692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.180826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbb3453986b4203a632cbdbbb15c6a5, user_id=eddd8e1656254bb0b75d0cc7e5c12b42, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.180826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.182678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:36.249371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcedc-27cf-4c6a-8461-cf756ebb85c9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.254110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.254915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.255196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.255461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] PATH_INFO: `/v3/projects/faa6d8e0b3c64536b3c93d0925de562b/users/4bc63726077349f3bb728041975fecba/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.270986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 799/1606] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:36 2022] PUT /identity/v3/projects/8dbb3453986b4203a632cbdbbb15c6a5/users/eddd8e1656254bb0b75d0cc7e5c12b42/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:36.272277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.286633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa6d8e0b3c64536b3c93d0925de562b, user_id=4bc63726077349f3bb728041975fecba, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.292144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b5b7-cfcb-4e2d-b581-d32f4761b1ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.354612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7207b4-9f66-4f3e-9ef6-b1a29b5b5402 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.359492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.362618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.362618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.362618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] PATH_INFO: `/v3/projects/213a05c992e74908b842c96a81fbc964/users/f0b2b03c836b45cc9658d6031c01579e/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.376606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213a05c992e74908b842c96a81fbc964, user_id=f0b2b03c836b45cc9658d6031c01579e, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.379285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7e605-79cc-4be9-9b5e-103fd7f2c751 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.422839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 808/1607] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:36 2022] PUT /identity/v3/projects/faa6d8e0b3c64536b3c93d0925de562b/users/4bc63726077349f3bb728041975fecba/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:36.424188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.425045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.425045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.452870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] MFA Rules not processed for user `b870b5ae143c4104ab02446b0740bc42`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.454191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.481791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 800/1608] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:36 2022] PUT /identity/v3/projects/213a05c992e74908b842c96a81fbc964/users/f0b2b03c836b45cc9658d6031c01579e/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:36.481791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aec17-68ca-4c03-9c47-221894542322 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.481791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aec17-68ca-4c03-9c47-221894542322 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.481791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aec17-68ca-4c03-9c47-221894542322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.488003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:36.510304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-cb2aec17-68ca-4c03-9c47-221894542322 None None] MFA Rules not processed for user `f27cb77779854919af18462926645090`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.511994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cb2aec17-68ca-4c03-9c47-221894542322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.527510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 809/1609] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.531571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.582827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 801/1610] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.584367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206226e8-e6d8-4daf-8e55-253286332813 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.584950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206226e8-e6d8-4daf-8e55-253286332813 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.585491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206226e8-e6d8-4daf-8e55-253286332813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.601261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd239-ef44-4a6f-8c47-cfbc3d62fc6a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.615327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-206226e8-e6d8-4daf-8e55-253286332813 None None] MFA Rules not processed for user `6857802102bb4b278ebf3085b6917142`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.616816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-206226e8-e6d8-4daf-8e55-253286332813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.676861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.677473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.677753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.678020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.678665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.680309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ca143-35e4-485f-9c61-27e535026858 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.687386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:36.695369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 810/1611] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:36.695369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1a70-fed4-47f6-9e39-daad203ac606 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.695369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1a70-fed4-47f6-9e39-daad203ac606 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.695369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1a70-fed4-47f6-9e39-daad203ac606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.701246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 802/1612] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.702411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.702695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.703008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.715814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-696a1a70-fed4-47f6-9e39-daad203ac606 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.717116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-696a1a70-fed4-47f6-9e39-daad203ac606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.723505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.724999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.726010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 811/1613] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.727353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.727709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.727898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.743694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 803/1614] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.745293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.759816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] MFA Rules not processed for user `f0b2b03c836b45cc9658d6031c01579e`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:36.761534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:36.764171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e124b-ecd7-4e37-ac72-7cddefb7a755 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.769997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.770605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.770943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.771314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.771976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.773877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.828844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:36.834179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 812/1615] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:36.835043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:36.848693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b98b-f098-4cb3-b23a-b2b9af397b68 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:36.853355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:36.855137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:36.855235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:36.855461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:36.856242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:36.858144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:36.945046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 804/1616] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:36.945856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.020771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cad2-d95c-4668-9caf-60ec2220d31c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.027923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 813/1617] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:36 2022] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:37.028737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.028868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.032018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.032319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.032601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] PATH_INFO: `/v3/projects/786ab145abc14e90b22d987ae37db52f/users/632b552cb3034ee688f6cb631b3761ac/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.048568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786ab145abc14e90b22d987ae37db52f, user_id=632b552cb3034ee688f6cb631b3761ac, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.051272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.113261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6a2f-d780-48c0-ae8c-c32ff6d6852a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.117928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.118532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.118868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.119196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.119826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.121763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.143622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 805/1618] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:36 2022] PUT /identity/v3/projects/786ab145abc14e90b22d987ae37db52f/users/632b552cb3034ee688f6cb631b3761ac/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:37.144600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.207715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43a798-bdc5-4283-a7c9-715fa77f6324 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.211506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.212104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.212379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.212647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.226631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 814/1619] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:37 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:37.227880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.299294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bed66-3315-4ec9-a1e9-9f5906224d21 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.303760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.305320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122eef-197a-4bfa-8c92-7825ed9e43b4 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.307676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.308454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.308847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.309119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.314962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:37.326422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 806/1620] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:37.328401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e2b6-6416-47ba-8a06-6d3d0c9f796d None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.328692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e2b6-6416-47ba-8a06-6d3d0c9f796d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.329021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e2b6-6416-47ba-8a06-6d3d0c9f796d None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.330903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 807/1621] 10.222.0.58 () {54 vars in 962 bytes} [Thu Sep 1 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:37.331701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e2b6-6416-47ba-8a06-6d3d0c9f796d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.413714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.415230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.419526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e2b6-6416-47ba-8a06-6d3d0c9f796d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.424294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.424486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.424759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.425334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.425652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.429329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.430084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 815/1622] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:37.431319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.442525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168894a5-47ba-4c72-b012-5b3bedaf5310 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.448293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.449156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.449761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.450114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.451013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.453195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.464430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:37.523880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 808/1623] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:37 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:37.523880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.534381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d798f-9ad8-4779-8c45-121042f0207c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.539708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.540238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 816/1624] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:37 2022] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:37.540363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.540622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.540930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.541703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.543527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caa74c-dcf5-43bd-8997-606db64c49ac admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.545506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.555120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 809/1625] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:37.555813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea178e-77e6-4587-8dff-90abe6a7fc91 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.560005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.560297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.560574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.561711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.562302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.562716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.566496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.566496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.566496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.604564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:37.605943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:37.669855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 817/1626] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:37 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:37.670965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.689686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08a40-b064-42ee-b6f2-460e4ac1d2a3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.695399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 810/1627] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Sep 1 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:37.695915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.702571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.703571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.704043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.704522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.705377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.707899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.714581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaacec-2d47-42ea-9ad8-3c8cae490416 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.723376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 818/1628] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:37.724721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.726257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.727828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.728315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.729149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.729809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.731961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.741757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3901e-976e-43c7-9404-9c2c729491f4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.746164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 811/1629] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:37.748009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.755536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.756221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.756498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.756951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] PATH_INFO: `/v3/projects/786ab145abc14e90b22d987ae37db52f/users/632b552cb3034ee688f6cb631b3761ac/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.759780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eb286-b994-417e-b472-7cf1b83be18e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.760139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786ab145abc14e90b22d987ae37db52f, user_id=632b552cb3034ee688f6cb631b3761ac, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.764296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.767549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.773935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.773935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.773935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.773935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.773935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.780199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 819/1630] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:37 2022] PUT /identity/v3/projects/786ab145abc14e90b22d987ae37db52f/users/632b552cb3034ee688f6cb631b3761ac/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:37.781808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.786974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 812/1631] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:37.787904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.814659 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e23a-051c-4d8d-bd16-fdc8a44bff7c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.872240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:37.877883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e2b6-17a4-460c-beec-dc83135c2007 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.883879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.884488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.884958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.885256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.898800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.899484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.900126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.900126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:37.901582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:37.902653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:37.913592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 813/1632] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:37.918221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:37.928836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c96f5-b914-4b1e-b36c-8f2fd369729e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:37.938032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:37.938704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:37.939024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:37.939686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] PATH_INFO: `/v3/projects/180f1ea22e1c4d32bb01a7458e692340/users/8995b61ffe7e4f7eb0decf9c4de77f0d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.084758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f1ea22e1c4d32bb01a7458e692340, user_id=8995b61ffe7e4f7eb0decf9c4de77f0d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.084758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281524-2ac8-498f-9a4a-5700e9f7ed4f service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 820/1633] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.086157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.086715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] MFA Rules not processed for user `632b552cb3034ee688f6cb631b3761ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:38.086715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:38.115389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:38.119329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 814/1634] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:37 2022] PUT /identity/v3/projects/180f1ea22e1c4d32bb01a7458e692340/users/8995b61ffe7e4f7eb0decf9c4de77f0d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:38.119329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.190788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 821/1635] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:38.191970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.207374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bc659-f9fb-472d-9035-3e8860d2281b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.215034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:38.216137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.216373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78ce3c-8df6-48fa-9d63-0fc286a190a9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.216888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.217467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] PATH_INFO: `/v3/projects/271ebb79db7b48b485bda05774e27517/users/b1f742316f524fffb3b284a08beefece/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.227443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:38.229143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.231092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.231654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] PATH_INFO: `/v3/projects/58489e34001641ea88595cd8f64790c3/users/1c5f9a54b4fe4117ba8e81df75c66fbd/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.238169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271ebb79db7b48b485bda05774e27517, user_id=b1f742316f524fffb3b284a08beefece, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.242107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.256501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58489e34001641ea88595cd8f64790c3, user_id=1c5f9a54b4fe4117ba8e81df75c66fbd, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.261118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.463555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 822/1636] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:38 2022] PUT /identity/v3/projects/271ebb79db7b48b485bda05774e27517/users/b1f742316f524fffb3b284a08beefece/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:38.463555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.464722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 815/1637] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:38 2022] PUT /identity/v3/projects/58489e34001641ea88595cd8f64790c3/users/1c5f9a54b4fe4117ba8e81df75c66fbd/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:38.464722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.505821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948439a-a69e-4404-a785-fcb8c799a3f0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.509211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df355a3c-2b6b-42dd-8fe0-f0aadb782bb5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.511183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:38.512120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.512611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.514180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.580145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:38.591765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:38.592503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.592983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.593350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.594285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.597193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e2ae-f08f-4997-91ca-c9cf7f4f34c5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.601076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.602599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.614253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 823/1638] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:38.623246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5070-d4ce-4a43-bd0f-e5d1e0e49b66 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.623246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5070-d4ce-4a43-bd0f-e5d1e0e49b66 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.623246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5070-d4ce-4a43-bd0f-e5d1e0e49b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.647133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 816/1639] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:38.647133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.652811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025036-62fa-409d-80d3-56ed4ec5b431 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.655491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f5cd5070-d4ce-4a43-bd0f-e5d1e0e49b66 None None] MFA Rules not processed for user `b1f742316f524fffb3b284a08beefece`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:38.657527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f5cd5070-d4ce-4a43-bd0f-e5d1e0e49b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:38.657749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:38.658367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:38.658652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:38.658976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:38.659633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:38.661354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:38.999973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 817/1640] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:38.999973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:38.999973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af716-d690-4469-9463-9534dfd247c1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:38.999973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.001404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.001404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.001404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] PATH_INFO: `/v3/projects/180f1ea22e1c4d32bb01a7458e692340/users/8995b61ffe7e4f7eb0decf9c4de77f0d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.001404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f1ea22e1c4d32bb01a7458e692340, user_id=8995b61ffe7e4f7eb0decf9c4de77f0d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.001404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.001939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 818/1641] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:38 2022] PUT /identity/v3/projects/180f1ea22e1c4d32bb01a7458e692340/users/8995b61ffe7e4f7eb0decf9c4de77f0d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:39.001939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 824/1642] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213a5f-3fb7-4cbc-ad28-bef89f890c99 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213a5f-3fb7-4cbc-ad28-bef89f890c99 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213a5f-3fb7-4cbc-ad28-bef89f890c99 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 825/1643] 10.222.0.58 () {54 vars in 962 bytes} [Thu Sep 1 18:03:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:39.002490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409cf56-784e-488b-9d2d-407f662a08bf None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.003341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409cf56-784e-488b-9d2d-407f662a08bf None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.003341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409cf56-784e-488b-9d2d-407f662a08bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.003553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2030137-a478-4707-8da5-642f276a105d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.003553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.003553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.003553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.004612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] PATH_INFO: `/v3/projects/58489e34001641ea88595cd8f64790c3/users/1c5f9a54b4fe4117ba8e81df75c66fbd/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.004612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58489e34001641ea88595cd8f64790c3, user_id=1c5f9a54b4fe4117ba8e81df75c66fbd, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.004612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.004957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1409cf56-784e-488b-9d2d-407f662a08bf None None] MFA Rules not processed for user `8995b61ffe7e4f7eb0decf9c4de77f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:39.004957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1409cf56-784e-488b-9d2d-407f662a08bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:39.005231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 819/1644] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:38 2022] PUT /identity/v3/projects/58489e34001641ea88595cd8f64790c3/users/1c5f9a54b4fe4117ba8e81df75c66fbd/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:39.005231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.005231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafc3e2-2ef9-460d-8cd8-9a13f438e8c8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.005231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.005584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.005584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.005584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.005584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.005584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b90b5f-2683-4776-85c0-8cf86e488aed admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.034302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 826/1645] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:39.040965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.041117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.041872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.085692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:39.087641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:39.101419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 820/1646] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:38 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:39.106420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.107780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.108164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.171850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] MFA Rules not processed for user `1c5f9a54b4fe4117ba8e81df75c66fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:39.173223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:39.244419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 827/1647] 10.222.0.58 () {58 vars in 1059 bytes} [Thu Sep 1 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:39.245741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.289002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 821/1648] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:39.289257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.327276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e650-d8bf-429c-acfe-6b8aa9028921 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.376957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad99f-108c-4ab3-9acc-61ccc75ef9d0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.382062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.382865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.383293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.383668 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.384411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.387367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.397274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.397909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.398236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.398511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.472521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.474952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7ca1c-c960-401e-aacc-783b9a502319 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.488280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 828/1649] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:39.491510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ceab-0cc6-4932-b3fa-065195725d42 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.491924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ceab-0cc6-4932-b3fa-065195725d42 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.492535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ceab-0cc6-4932-b3fa-065195725d42 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.495204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 829/1650] 10.222.0.58 () {54 vars in 912 bytes} [Thu Sep 1 18:03:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:39.500783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.501339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.501984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.534360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 822/1651] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:39 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:39.538760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.546936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:39.548948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:39.569849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03bbb-e977-47bc-a62a-11c48bc37841 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.581795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.582472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.582813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.586608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.587092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.591557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.604272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 823/1652] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:39.605190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.616734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c3d91-df02-423f-a412-9ada1872120f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.621754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.624912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.624912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.624912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.638439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.640848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.652793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 824/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:39.653769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.670119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b6fc6-172d-489a-bc2b-554cc0c3a5f5 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.677223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:39.678271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:39.678785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:39.679168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] PATH_INFO: `/v3/projects/6089195451964d7e9dea1853053c7ab5/users/025858c45fea4ce78b5d015cb86acd3d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:39.692941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:39.739440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6089195451964d7e9dea1853053c7ab5, user_id=025858c45fea4ce78b5d015cb86acd3d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:39.739618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 830/1654] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:39.742909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:39.866001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 825/1655] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:39 2022] PUT /identity/v3/projects/6089195451964d7e9dea1853053c7ab5/users/025858c45fea4ce78b5d015cb86acd3d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:39.867243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:39.891891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db90a4e-43f6-4c65-87a6-8e45fdf76441 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:39.907860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.040460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e805-9f92-4ccd-911e-68edaf81d46a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.057762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.058832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.059120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.059473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.062412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.067893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.068814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.069914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.076276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.079995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:40.116705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:40.126182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 831/1656] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:03:40.133672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.162576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c71a83-5359-4b5c-a3dc-fe3da7238bac admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.174047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.174760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.175068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.175339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] PATH_INFO: `/v3/projects/6089195451964d7e9dea1853053c7ab5/users/025858c45fea4ce78b5d015cb86acd3d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.186562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6089195451964d7e9dea1853053c7ab5, user_id=025858c45fea4ce78b5d015cb86acd3d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.192634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf22a1-c36b-4f47-988a-4132ed1a0146 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:40.223300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 832/1657] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:40 2022] PUT /identity/v3/projects/6089195451964d7e9dea1853053c7ab5/users/025858c45fea4ce78b5d015cb86acd3d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:40.240933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.240933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b43be-0a4c-4f7d-a2bc-b0624296d2a0 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:40.242351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.243691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.245111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.270290 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 826/1658] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:03:40.273334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c40ca-8b42-4a94-bff5-b69230d09491 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.274654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c40ca-8b42-4a94-bff5-b69230d09491 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.274850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c40ca-8b42-4a94-bff5-b69230d09491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.304978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] MFA Rules not processed for user `025858c45fea4ce78b5d015cb86acd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:40.309612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:40.352807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b76c40ca-8b42-4a94-bff5-b69230d09491 None None] MFA Rules not processed for user `eddd8e1656254bb0b75d0cc7e5c12b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:40.352807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b76c40ca-8b42-4a94-bff5-b69230d09491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:40.489999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 833/1659] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:40.489999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.518797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 827/1660] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:40.520073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da7ff-deb9-4c46-ad89-8c8ed1578787 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.520366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da7ff-deb9-4c46-ad89-8c8ed1578787 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.520641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da7ff-deb9-4c46-ad89-8c8ed1578787 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.525652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 828/1661] 10.222.0.58 () {54 vars in 912 bytes} [Thu Sep 1 18:03:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:40.530416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373da7ff-deb9-4c46-ad89-8c8ed1578787 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.562862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f028075-7f72-4bf7-a695-7cf04e538483 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.568827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.569505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.569840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.570168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.641252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.645890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25cee2-b4ed-4ac9-b1a3-1203d7e47903 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:40.646019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373da7ff-deb9-4c46-ad89-8c8ed1578787 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.657774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.658415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.660826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.667772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.667772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.667772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:40.668208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 834/1662] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:40.670080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.670367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.670628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.710022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:40.710998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:40.715465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:40.811305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 829/1663] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:40 2022] POST /identity/v3/projects => generated 403 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:40.812385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.820155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 835/1664] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:40.821032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:40.833396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680f1d5-a19f-493f-9039-2eca51fdb84c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.887795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33575b-fc75-4707-83c0-b73311597fe0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:40.892933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.893653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.894005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.894355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.912992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:40.943352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:40.944385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:40.944742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:40.945091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] PATH_INFO: `/v3/users/f27cb77779854919af18462926645090` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:40.946570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27cb77779854919af18462926645090)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:40.948575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: WARNING py.warnings [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:40.948575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: warnings.warn(msg) Sep 01 18:03:40.948575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: Sep 01 18:03:40.950058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.000445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.002569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.020850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 830/1665] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:41.022261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.037731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84560c8-a617-450f-94d3-92db98658ed1 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.044639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.045821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.046081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.051976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.051976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.051976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.149549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 831/1666] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:41 2022] POST /identity/v3/users => generated 308 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:41.151883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.171344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891f11-01a2-42f8-8ad3-b4e0c3b85efa admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.177533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:41.181005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.183248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.183797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.184149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.230960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27cb77779854919af18462926645090'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:41.282491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.284303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.292342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27cb77779854919af18462926645090'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:41.310435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 832/1667] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:41.313758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.339751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392feb2-5308-4774-9cab-e1e340e9af2d service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.372119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.374037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.374330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.374608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.376439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.381093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.393834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27cb77779854919af18462926645090'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:41.427854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 833/1668] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:41.432739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.474697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27cb77779854919af18462926645090'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:41.474697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27cb77779854919af18462926645090'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:41.474982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67458-0cec-4979-8a00-229f91ff79e0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.488204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.489004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.489381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.489750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] PATH_INFO: `/v3/projects/85919d69052c4352bc7451e8a6826adb/users/02b3662c580444b98a4c12db61e61202/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.506057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 836/1669] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:40 2022] DELETE /identity/v3/users/f27cb77779854919af18462926645090 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:41.509467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.514310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:41.514887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85919d69052c4352bc7451e8a6826adb, user_id=02b3662c580444b98a4c12db61e61202, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.518007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cddbd-8097-4ffb-a3ad-7f1f337ec369 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.654921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 834/1670] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:41 2022] PUT /identity/v3/projects/85919d69052c4352bc7451e8a6826adb/users/02b3662c580444b98a4c12db61e61202/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:41.656872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.657689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc9828-8747-43fc-ae2b-e2741f8fbc70 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.659913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.659913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.719088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:41.720347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:41.760195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.762156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.763442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.763876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] PATH_INFO: `/v3/users/f0b2b03c836b45cc9658d6031c01579e` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.766480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b2b03c836b45cc9658d6031c01579e)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.769750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.830382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 835/1671] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:41.830382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.830382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:41.856114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee457d5-3abb-484c-b4fb-4083aa105086 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:41.861484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:41.862087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:41.862466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:41.862890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:41.863627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:41.865434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:41.879141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 836/1672] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:41.880676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:41.883432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:41.993706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f025d3d-a952-44c4-bd82-6416fe70a1b8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:42.003310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:42.003508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:42.005895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:42.005895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:42.030046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:42.032952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:42.044617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:42.050609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 837/1673] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:42.051554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:42.063724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3737e-e2fb-4225-bea7-6cdb0d91a2e6 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:42.070230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:42.071446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:42.071741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:42.072042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] PATH_INFO: `/v3/projects/85919d69052c4352bc7451e8a6826adb/users/02b3662c580444b98a4c12db61e61202/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:42.074847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85919d69052c4352bc7451e8a6826adb, user_id=02b3662c580444b98a4c12db61e61202, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:42.078392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969b98-b8f8-4730-9692-29ff048a9fd1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:42.098772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b2b03c836b45cc9658d6031c01579e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:42.108060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 838/1674] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:42 2022] PUT /identity/v3/projects/85919d69052c4352bc7451e8a6826adb/users/02b3662c580444b98a4c12db61e61202/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:42.126324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b2b03c836b45cc9658d6031c01579e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:42.258202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b2b03c836b45cc9658d6031c01579e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:42.287074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b2b03c836b45cc9658d6031c01579e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:42.289627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b2b03c836b45cc9658d6031c01579e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:42.309830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 837/1675] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:41 2022] DELETE /identity/v3/users/f0b2b03c836b45cc9658d6031c01579e => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:42.314121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:42.314417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:42.314696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:42.335976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:42.337322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:42.423368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 839/1676] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:42.428206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:42.439635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:42.441153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:42.559049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360584a-5872-46f9-a209-6b6cb320a49e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:42.573180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:42.574010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:42.574695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:42.575102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:42.606007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:42.607920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:42.686518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 838/1677] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:43.282770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:43.284938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:43.361121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5e0d-21bd-4d5a-8eca-affb9750affd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:43.365053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:43.366638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:43.367311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:43.367586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:43.370140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:43.477063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:43.480331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:43.483514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:43.484687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:43.501833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 840/1678] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:43.523328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0287e-758b-460f-ae1b-547eab15905f service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:43.587282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:43.587282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:43.587282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:43.587282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] PATH_INFO: `/v3/projects/65d0be9d64aa473f846619ccc323e06b` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:43.589705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d0be9d64aa473f846619ccc323e06b)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:43.589705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:43.788407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:43.790221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:43.806028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d0be9d64aa473f846619ccc323e06b', 'request_id': 'req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:43.827677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d0be9d64aa473f846619ccc323e06b', 'request_id': 'req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:43.832216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a0c-33db-468e-84ec-667fbec8ef31 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:43.956649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d0be9d64aa473f846619ccc323e06b', 'request_id': 'req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:43.960642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:43.991186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] The token cache is being invalidate because project 65d0be9d64aa473f846619ccc323e06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:43.993790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:43.996113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.009172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 839/1679] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:43 2022] DELETE /identity/v3/projects/65d0be9d64aa473f846619ccc323e06b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:44.010945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:44.014018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:44.029680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:44.029680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:44.029680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:44.029680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] PATH_INFO: `/v3/projects/213a05c992e74908b842c96a81fbc964` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:44.033342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=213a05c992e74908b842c96a81fbc964)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:44.034830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: WARNING py.warnings [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 18:03:44.034830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: warnings.warn(msg) Sep 01 18:03:44.034830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: Sep 01 18:03:44.037433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:44.052190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5fbef-f83b-4ca2-a522-6761ce6527ee admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:44.067606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:44.068697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:44.069120 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:44.071267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] PATH_INFO: `/v3/users/8995b61ffe7e4f7eb0decf9c4de77f0d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:44.075402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8995b61ffe7e4f7eb0decf9c4de77f0d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:44.094109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:44.511700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8995b61ffe7e4f7eb0decf9c4de77f0d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.534537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213a05c992e74908b842c96a81fbc964', 'request_id': 'req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.538203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8995b61ffe7e4f7eb0decf9c4de77f0d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.554613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213a05c992e74908b842c96a81fbc964', 'request_id': 'req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.563666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213a05c992e74908b842c96a81fbc964', 'request_id': 'req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.656250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8995b61ffe7e4f7eb0decf9c4de77f0d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.679524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8995b61ffe7e4f7eb0decf9c4de77f0d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.683019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8995b61ffe7e4f7eb0decf9c4de77f0d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.695287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 840/1680] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:44 2022] DELETE /identity/v3/users/8995b61ffe7e4f7eb0decf9c4de77f0d => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:44.696281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:44.698624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:44.800240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] The token cache is being invalidate because project 213a05c992e74908b842c96a81fbc964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:44.800881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.813810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-37d10646-938f-4636-b9a1-9fd9fa2b3dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:44.815313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 841/1681] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:43 2022] DELETE /identity/v3/projects/213a05c992e74908b842c96a81fbc964 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:03:44.822995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0189d6-01df-467f-bc0a-2b6eece4408f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:44.823428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0189d6-01df-467f-bc0a-2b6eece4408f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:44.823713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0189d6-01df-467f-bc0a-2b6eece4408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:44.825038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e53b9-bdb9-4e69-a9ca-bcd5f7871075 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:44.839002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:44.839644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:44.839905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:44.840510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:44.843269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:44.894352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6b0189d6-01df-467f-bc0a-2b6eece4408f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:44.934528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6b0189d6-01df-467f-bc0a-2b6eece4408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:44.977774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:44.982005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f82910-ade4-46eb-87f9-b8e6970320b8 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.008849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 841/1682] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:45.065392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 842/1683] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:45.076751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.077263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.077709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.104437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.104729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.105005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.107465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:45.109755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:45.151991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 842/1684] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:45.153714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.161042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] MFA Rules not processed for user `02b3662c580444b98a4c12db61e61202`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:45.162575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:45.191163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae648b2-b3fd-4060-a7b4-e6e225831b4c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:45.216905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:45.217782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.221529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.221688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.222987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:45.222987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:45.229616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.263537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 843/1685] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:45.268418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.285850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1979e06-466b-4262-b607-097dfd202bed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:45.299284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:45.300298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.300574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.300876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.305800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:45.308206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.317812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 843/1686] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:45.476687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 844/1687] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:45 2022] POST /identity/v3/projects => generated 355 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:03:45.479592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.496458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068438a-20da-48e8-b1d1-35c2351ddc5f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:45.601443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.603233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:45.626045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:45.626871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.627310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.627740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.628550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:45.630717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.731458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802eb3b-fa33-4af3-bc40-58d3d1b3a5cd admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:45.738899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:45.738899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.738899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.738899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] PATH_INFO: `/v3/projects/180f1ea22e1c4d32bb01a7458e692340` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.739463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=180f1ea22e1c4d32bb01a7458e692340)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:45.741677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.821845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 844/1688] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:45 2022] POST /identity/v3/users => generated 278 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:45.826199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.851165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc47a-6fd3-4513-a175-ff11f261452b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:45.873042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:45.873697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:45.874171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:45.874455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:45.875328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:45.877131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:45.929301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 845/1689] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:45.929301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:45.958976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ab0e-154b-4fb3-ad57-c79ad9f64562 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:46.016231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180f1ea22e1c4d32bb01a7458e692340', 'request_id': 'req-5caec282-910a-44aa-b0ef-a56dc0b15d9b'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:46.031308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180f1ea22e1c4d32bb01a7458e692340', 'request_id': 'req-5caec282-910a-44aa-b0ef-a56dc0b15d9b'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:46.063201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:46.113218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180f1ea22e1c4d32bb01a7458e692340', 'request_id': 'req-5caec282-910a-44aa-b0ef-a56dc0b15d9b'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:46.113602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:46.114233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.118717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.122296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.122296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:46.124287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:46.131544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] The token cache is being invalidate because project 180f1ea22e1c4d32bb01a7458e692340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:46.131842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:46.140765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 846/1690] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:03:46.140964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5caec282-910a-44aa-b0ef-a56dc0b15d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:46.141982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:46.142934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 845/1691] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:45 2022] DELETE /identity/v3/projects/180f1ea22e1c4d32bb01a7458e692340 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:03:46.147396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac76a-e5bc-4c67-9fb7-8177d242e525 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.147709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac76a-e5bc-4c67-9fb7-8177d242e525 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.147915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.148029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ac76a-e5bc-4c67-9fb7-8177d242e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.189425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a14ac76a-e5bc-4c67-9fb7-8177d242e525 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:46.189680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f17c-8164-4276-8e9b-1a8084f52495 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:46.190702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a14ac76a-e5bc-4c67-9fb7-8177d242e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.198577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:46.200422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.202038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.203633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] PATH_INFO: `/v3/projects/c68236a30ca34d7fbaa2fdfe1d649c6c/users/78c6da83f38c496b841a79c5101b36c0/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.214008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 846/1692] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:46.215376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5f12-770e-4c65-9990-84ad054771b0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.216394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5f12-770e-4c65-9990-84ad054771b0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.216394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5f12-770e-4c65-9990-84ad054771b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.233390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68236a30ca34d7fbaa2fdfe1d649c6c, user_id=78c6da83f38c496b841a79c5101b36c0, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:46.240843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a922ea-1486-49dd-aaf9-ac3919cc7c33 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:46.270218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b56d5f12-770e-4c65-9990-84ad054771b0 None None] MFA Rules not processed for user `93a6ff3696014b9eb0ce7eab09922e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:46.271328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b56d5f12-770e-4c65-9990-84ad054771b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.358868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 847/1693] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:46 2022] PUT /identity/v3/projects/c68236a30ca34d7fbaa2fdfe1d649c6c/users/78c6da83f38c496b841a79c5101b36c0/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:46.360283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.360581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.360864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.362045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 847/1694] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:46.371399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714971-56a1-4126-8bb5-dfc73a1728c8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.371893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714971-56a1-4126-8bb5-dfc73a1728c8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.372887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714971-56a1-4126-8bb5-dfc73a1728c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.434536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1b714971-56a1-4126-8bb5-dfc73a1728c8 None None] MFA Rules not processed for user `78c6da83f38c496b841a79c5101b36c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:46.437127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:46.437751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1b714971-56a1-4126-8bb5-dfc73a1728c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.439083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.446772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:46.613621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 848/1695] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:46.619217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.622066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.622593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.624063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 848/1696] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:46.624971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:46.647037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32175-3659-453a-9f3f-0f35fdce2bb1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:46.662391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:46.663399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.664007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.664428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.665234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:46.668037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:46.681488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] MFA Rules not processed for user `93a6ff3696014b9eb0ce7eab09922e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:46.684676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.794038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 849/1697] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:46.795244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:46.809857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd858e-3f29-4bb6-89a6-519134a901d7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:46.818365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:46.819859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:46.820358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:46.820837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:46.821710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:46.823281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:46.825379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:46.843138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 850/1698] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:46.844311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:46.846199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:46.860779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 849/1699] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/projects => generated 357 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:46.860779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:46.985790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bec10-b3fb-40fd-a671-e9efa796de59 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.045606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eed5e-d091-45da-9cb6-de524d3ec38c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.072574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.073833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.077872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.078466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.079373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.085434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c0b3e-2252-416e-8a7e-9c6bd3ee427b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.101175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.102492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.102492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.102492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.221996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.223761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.257687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 851/1700] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:47.258907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.284494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 850/1701] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:47.287217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130e1bd-9739-4542-9487-a5bf34cc5096 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.288374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b776c-af2b-411c-853b-4d091ba7fb21 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.288664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b776c-af2b-411c-853b-4d091ba7fb21 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.293238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b776c-af2b-411c-853b-4d091ba7fb21 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.297620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 851/1702] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:03:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:47.303732 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b776c-af2b-411c-853b-4d091ba7fb21 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.389989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b776c-af2b-411c-853b-4d091ba7fb21 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.390839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.391452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.391727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.392135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.392619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.394720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2c72-6e97-4f5d-8a79-9eca42558c07 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.432460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.432460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.432460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.432460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.432790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.433620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.541033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 852/1703] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:47 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:47.544252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76180a-a579-40e5-b456-86843de1457f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.544252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76180a-a579-40e5-b456-86843de1457f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.544252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76180a-a579-40e5-b456-86843de1457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.576005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 852/1704] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:47 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:47.578619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.596369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6a76180a-a579-40e5-b456-86843de1457f None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:47.598880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6a76180a-a579-40e5-b456-86843de1457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:47.603905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c1fc-67c2-4db6-8d6c-6f8054fa6e4f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.614069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.616508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.624581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.624581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.624581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.624581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.638613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 853/1705] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:47.638613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.656081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005e8b-cdec-4dcd-9120-11c8927b3268 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.668952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.671610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.672064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.672584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.674231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.679289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.717865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 854/1706] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:47.717865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.724988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 853/1707] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:03:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:47.726963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76180a-a579-40e5-b456-86843de1457f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.744307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48702f-05b8-4249-a2d1-a0f734955077 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.761472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76180a-a579-40e5-b456-86843de1457f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.767173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.776373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.776747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.778542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.779048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.783857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.785906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.787902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.789198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.789571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] PATH_INFO: `/v3/projects/20594c55b640478b9261269520718ce9/users/5a3200aacaec4fd18ad240c0ce097542/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.814370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 855/1708] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:47.819313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.823511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:47.835924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20594c55b640478b9261269520718ce9, user_id=5a3200aacaec4fd18ad240c0ce097542, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.846920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.858994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba575c-ed92-4427-8f22-32946120a676 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:47.866851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:47.867714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:47.869496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:47.869917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:47.911479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:47.915403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:47.966933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 854/1709] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:47 2022] PUT /identity/v3/projects/20594c55b640478b9261269520718ce9/users/5a3200aacaec4fd18ad240c0ce097542/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:47.977114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:47.980568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 856/1710] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:47.985423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:48.018740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eafd31-8839-4fe1-9c2f-408dece37922 service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.169116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cfb58-9f83-489c-bbe5-b2c10b6c2f2f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.185963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.187906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.188315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.188864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] PATH_INFO: `/v3/projects/7f044e93b46b4c1596dc8221c0a6e87a/users/cccf864c99cb408f8263d1edc077a407/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.203592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.215183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.215652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.216138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.219481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.221257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae377ec-5601-4548-9fe5-8b6e8dc96967 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:48.241637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f044e93b46b4c1596dc8221c0a6e87a, user_id=cccf864c99cb408f8263d1edc077a407, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.244557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a2e85-ed10-4c22-80e2-31d522c7eac2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:48.254089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 857/1711] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:48.255685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34869d-bf9f-418e-b694-d190745b94a0 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.257238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34869d-bf9f-418e-b694-d190745b94a0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.258183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34869d-bf9f-418e-b694-d190745b94a0 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.260614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 858/1712] 10.222.0.58 () {54 vars in 912 bytes} [Thu Sep 1 18:03:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:48.261584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34869d-bf9f-418e-b694-d190745b94a0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:48.276627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34869d-bf9f-418e-b694-d190745b94a0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.282044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.282880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.283291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.283673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] PATH_INFO: `/v3/projects/20594c55b640478b9261269520718ce9/users/5a3200aacaec4fd18ad240c0ce097542/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.286664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=20594c55b640478b9261269520718ce9, user_id=5a3200aacaec4fd18ad240c0ce097542, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.290535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033296a-cad4-483a-b536-cdd35230c9aa admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:48.316310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 859/1713] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:48 2022] PUT /identity/v3/projects/20594c55b640478b9261269520718ce9/users/5a3200aacaec4fd18ad240c0ce097542/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:48.318863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d83e-c26b-4935-835e-a0eab0ed8c5a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.319304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d83e-c26b-4935-835e-a0eab0ed8c5a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.319759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d83e-c26b-4935-835e-a0eab0ed8c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.378643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 855/1714] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:47 2022] PUT /identity/v3/projects/7f044e93b46b4c1596dc8221c0a6e87a/users/cccf864c99cb408f8263d1edc077a407/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:48.380710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.382401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.382947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.419256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-99c8d83e-c26b-4935-835e-a0eab0ed8c5a None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:48.421141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-99c8d83e-c26b-4935-835e-a0eab0ed8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:48.464278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] MFA Rules not processed for user `5a3200aacaec4fd18ad240c0ce097542`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:48.465778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:48.557343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 860/1715] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:03:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:48.558807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.559105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.559389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.604787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] MFA Rules not processed for user `cccf864c99cb408f8263d1edc077a407`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:48.614119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:48.614248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 856/1716] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:48.614248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:48.614248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:48.627788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6d319-38f9-42bc-9ff5-f6a3f323068e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.632718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.633463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.633819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.634167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.643024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.644981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:48.649814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:48.659226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 857/1717] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:48.689979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:48.694108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:48.694238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 861/1718] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:48.697680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:48.824776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b554-7cf0-41ad-bdd0-9e89acdde636 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.830291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.831043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.831330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.831671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.843697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.845845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa649f5e-0c58-4f66-9d5b-7a5ef2ea2433 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:48.853208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539752-d029-4834-aff2-33bddb475bdc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:48.857773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 858/1719] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:03:48.863881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:48.864510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:48.864795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:48.865071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:48.865897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:48.867905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.078511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 862/1720] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:48 2022] POST /identity/v3/projects => generated 371 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:49.078634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1372a-9944-47cb-be72-3c4bdd7c50fd None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.078634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1372a-9944-47cb-be72-3c4bdd7c50fd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.078634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1372a-9944-47cb-be72-3c4bdd7c50fd None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.078634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 859/1721] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:49.078953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.129744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.130825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.130825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.135202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:49.169160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:49.169448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:49.227239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5386-97a1-4992-9697-b0f1d97b72b3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.247459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.248389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.248867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.249395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.250220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.252525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.308323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 860/1722] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:03:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:49.344002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.368868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 863/1723] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:49 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:49.370713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.373862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:49.377518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9178d-b121-43c3-8777-abc4ef537e8d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.392686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.393631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.394019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.395584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.455535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.460378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.491792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 861/1724] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:03:49.493929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.505403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46fcc7-1f3a-4760-8d7f-c21a4494b99c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.515726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.516363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.516643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.516913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.521834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446304f-3669-4686-9f80-47af05f57c77 service placement] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.533466 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.536730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.537026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.537306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.538548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.540228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.568124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 862/1725] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:49.570231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.578666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:49.629925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497ede-12ae-405b-8b78-5491417158f1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.639382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.639636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.640032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.640332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.640795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] PATH_INFO: `/v3/users/eddd8e1656254bb0b75d0cc7e5c12b42` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.641030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.642039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddd8e1656254bb0b75d0cc7e5c12b42)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.644339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.652363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 864/1726] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:49.653102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.664346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac29676-f927-4a16-bb33-b46544a32bb4 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:49.678038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:49.680106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:49.680785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:49.683881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] PATH_INFO: `/v3/projects/ed9a5179095843bea5c688d9405a7285/users/b8cc9e693b034e3d9385da1e6b1d7934/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:49.725121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9a5179095843bea5c688d9405a7285, user_id=b8cc9e693b034e3d9385da1e6b1d7934, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:49.730198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:49.860101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 865/1727] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:49 2022] PUT /identity/v3/projects/ed9a5179095843bea5c688d9405a7285/users/b8cc9e693b034e3d9385da1e6b1d7934/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:49.864834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:49.923361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddd8e1656254bb0b75d0cc7e5c12b42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:49.999773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddd8e1656254bb0b75d0cc7e5c12b42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:50.054184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898fe59-9dc4-4677-8da0-c4680e57e080 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:50.060949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:50.061590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:50.061927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:50.062197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:50.062953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:50.064866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:50.084151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 866/1728] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:50.084872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:50.188735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddd8e1656254bb0b75d0cc7e5c12b42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:50.189530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddd8e1656254bb0b75d0cc7e5c12b42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:50.207326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddd8e1656254bb0b75d0cc7e5c12b42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:50.208702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c6c0-2036-4c2c-a485-9859da6fb731 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:50.219499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:50.248758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 863/1729] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:49 2022] DELETE /identity/v3/users/eddd8e1656254bb0b75d0cc7e5c12b42 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:50.249355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:50.249727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:50.249852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:50.252447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:50.265027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:50.265118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:50.303245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:50.309956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89eb5-4765-48ee-99ff-471e75379f51 service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:50.335756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 867/1730] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:50.476579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72943ee-c235-4eac-b294-c9f7cea66567 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:50.501316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:50.505305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:50.505305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:50.505305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] PATH_INFO: `/v3/projects/ed9a5179095843bea5c688d9405a7285/users/b8cc9e693b034e3d9385da1e6b1d7934/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:50.505816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9a5179095843bea5c688d9405a7285, user_id=b8cc9e693b034e3d9385da1e6b1d7934, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:50.512948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:50.564878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 864/1731] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:50 2022] PUT /identity/v3/projects/ed9a5179095843bea5c688d9405a7285/users/b8cc9e693b034e3d9385da1e6b1d7934/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:50.568320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:50.568608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:50.569284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:50.656479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] MFA Rules not processed for user `b8cc9e693b034e3d9385da1e6b1d7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:50.659934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:50.817806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 868/1732] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:50.920262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:50.922115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:50.998479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34574b-e35b-40bd-8799-636dbff02323 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:51.002559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:51.003203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:51.003486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:51.003760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:51.014009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:51.015490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:51.025344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 865/1733] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:51.070078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:51.071707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:51.153645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2dd8f-02b5-4826-844c-cd4b95a630a0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:51.162017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:51.162633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:51.163095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:51.163440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] PATH_INFO: `/v3/projects/8dbb3453986b4203a632cbdbbb15c6a5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:51.164858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbb3453986b4203a632cbdbbb15c6a5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:51.167688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:51.427900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbb3453986b4203a632cbdbbb15c6a5', 'request_id': 'req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:51.431270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:51.442919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923817cb-e498-446f-ae2d-31b75c72b597 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:51.453472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbb3453986b4203a632cbdbbb15c6a5', 'request_id': 'req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:51.513347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:51.517690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:51.517690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:51.517690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:51.517690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:51.586274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:51.588672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:51.600102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 866/1734] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:51.680566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbb3453986b4203a632cbdbbb15c6a5', 'request_id': 'req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:51.705076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] The token cache is being invalidate because project 8dbb3453986b4203a632cbdbbb15c6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:51.705374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:51.708118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cf4d6639-6fda-4ebe-954f-9a3fbdfe41a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:51.711882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 869/1735] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:51 2022] DELETE /identity/v3/projects/8dbb3453986b4203a632cbdbbb15c6a5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:51.716308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:51.856572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78d25-0029-495e-a439-1189b6d501e2 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:51.857156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffff2-09fc-4f3a-bde2-0cc214b86e34 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:51.857450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffff2-09fc-4f3a-bde2-0cc214b86e34 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:51.857729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabffff2-09fc-4f3a-bde2-0cc214b86e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:51.861496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:51.862233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:51.862572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:51.862936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] PATH_INFO: `/v3/users/02b3662c580444b98a4c12db61e61202` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:51.864254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b3662c580444b98a4c12db61e61202)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:51.866163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:51.891537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-eabffff2-09fc-4f3a-bde2-0cc214b86e34 None None] MFA Rules not processed for user `4bc63726077349f3bb728041975fecba`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:51.892793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-eabffff2-09fc-4f3a-bde2-0cc214b86e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:51.903814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:52.003034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 870/1736] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:52.015888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.015888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.015888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.035172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] MFA Rules not processed for user `4bc63726077349f3bb728041975fecba`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:52.036431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:52.046335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 871/1737] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:52.060262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:52.061704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:52.136960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b3662c580444b98a4c12db61e61202'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:52.146432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b3662c580444b98a4c12db61e61202'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:52.147512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc21ad-4390-46eb-9203-6ff3c23b18d3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:52.171987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:52.171987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.171987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.171987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.173941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:52.175747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eecc0-cb30-4a0f-8568-3ce70fefd59c service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:52.188032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 872/1738] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:52.290092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b3662c580444b98a4c12db61e61202'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:52.290092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b3662c580444b98a4c12db61e61202'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:52.319891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5baf9e38-8544-4d3a-b7b5-93d6d3f69090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b3662c580444b98a4c12db61e61202'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:52.330805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 867/1739] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:51 2022] DELETE /identity/v3/users/02b3662c580444b98a4c12db61e61202 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:52.623626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.623910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.624186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.625719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 873/1740] 10.222.0.58 () {54 vars in 912 bytes} [Thu Sep 1 18:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:52.640872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.646165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.646165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.668496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:52.670112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:52.719421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:52.721307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:52.757172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 868/1741] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:03:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:52.771175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:52.772775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:52.786432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66588e-6d22-4ab7-b626-b2748fb472a9 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:52.790321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:52.790968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.791435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.791698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.804346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e36ad-e042-4389-b94a-a7262eecfebb None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:52.804573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:52.806381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afeb8c-0eef-47e3-9f05-7fd17ad6c3b1 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:52.811750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:52.814643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:52.814643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:52.814643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] PATH_INFO: `/v3/projects/85919d69052c4352bc7451e8a6826adb` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:52.814643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85919d69052c4352bc7451e8a6826adb)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:52.816898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 869/1742] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:52.817685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:52.953285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:53.117061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85919d69052c4352bc7451e8a6826adb', 'request_id': 'req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:53.159917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85919d69052c4352bc7451e8a6826adb', 'request_id': 'req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:53.246906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85919d69052c4352bc7451e8a6826adb', 'request_id': 'req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:53.275953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] The token cache is being invalidate because project 85919d69052c4352bc7451e8a6826adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:53.276307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:53.277945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a1dbc4f1-07e4-4e5c-a0c8-b0d23e1df41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:53.280017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 874/1743] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:52 2022] DELETE /identity/v3/projects/85919d69052c4352bc7451e8a6826adb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:03:53.285169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c488-0012-4df4-a10f-2c5c4f48a413 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.285529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c488-0012-4df4-a10f-2c5c4f48a413 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.285614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c488-0012-4df4-a10f-2c5c4f48a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.339410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7a43c488-0012-4df4-a10f-2c5c4f48a413 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:53.343672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7a43c488-0012-4df4-a10f-2c5c4f48a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:53.471692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.473626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.475201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.500858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 870/1744] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:53.511042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.511758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.512036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.535205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] MFA Rules not processed for user `4bc63726077349f3bb728041975fecba`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:53.540062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:53.545845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:53.547085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:53.568000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 871/1745] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:53.571943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:53.584544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6efe-1996-455c-8fd3-697ce727e5c7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:53.594175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:53.594175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.594175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.594175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.594465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:03:53.594465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:53.595726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:53.611146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 872/1746] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:03:53.615024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:53.629282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607014fa-f5ad-4c77-8d03-926312e147f1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:53.643204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:53.644284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.646880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.652089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.652089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:53.652089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:53.687668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 875/1747] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:53.830088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 873/1748] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:53 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:03:53.831054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:53.867662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b15c6a-9fb3-4803-bf19-19711ba0479a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:53.945991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:53.946699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:53.949117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:53.949433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:53.950526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:53.952537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:54.093701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 876/1749] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:53 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:03:54.098202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.112975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a8347-f463-451e-8bb4-82fdee835dab admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:54.118168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:54.120236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:54.120524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:54.121033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:54.121876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:54.123557 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:54.152325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.163761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa750db-d979-497e-ae53-c75de927158e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:54.167169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 874/1750] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:54.175586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:54.176252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:54.176540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:54.176817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:54.177633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:54.179322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7c1ae-ca26-4c8a-9e8c-a5fd93882085 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:54.196306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 877/1751] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:54.198941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.210631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312742-1bdb-445a-847f-a9037823b1c2 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:54.217608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:54.218560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:54.218925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:54.219451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] PATH_INFO: `/v3/projects/8c57f2c6fd01460fa95ab93bfac17ce1/users/f93de4c8a0b348f08809c69a5767ff31/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:54.241671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c57f2c6fd01460fa95ab93bfac17ce1, user_id=f93de4c8a0b348f08809c69a5767ff31, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:54.245211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:54.372977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 875/1752] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:54 2022] PUT /identity/v3/projects/8c57f2c6fd01460fa95ab93bfac17ce1/users/f93de4c8a0b348f08809c69a5767ff31/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:03:54.386084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:54.386671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:54.387932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:54.432419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] MFA Rules not processed for user `f93de4c8a0b348f08809c69a5767ff31`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:54.433658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:54.533586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 878/1753] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:54.537892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.656611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae201d2-8d0f-42e2-b8df-a92abe881b48 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:54.664245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:54.672182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:54.676938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:54.678117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:54.679219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:54.680102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:54.682929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:54.873242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 876/1754] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:03:54 2022] POST /identity/v3/projects => generated 363 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:54.877107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.897729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b7dd-7a59-4651-bce9-2391cb4bc25e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:54.977739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:54.983990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:55.122101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.123787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.124240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.124856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.125658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.127997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.178347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553aec-e0b9-464c-bf53-7281419ce7bc admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:55.196648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.197971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.201018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.202347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] PATH_INFO: `/v3/users/cccf864c99cb408f8263d1edc077a407` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.212472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccf864c99cb408f8263d1edc077a407)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.212472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.329510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 879/1755] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:03:54 2022] POST /identity/v3/users => generated 288 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:03:55.333090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:55.353108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0100719-5df7-4589-94ab-ef158fec34df admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:55.358895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.359519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.359865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.360060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.360817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.363322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.423995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 880/1756] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:03:55.424967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:55.496956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9952b9-4fda-4f7e-b260-fdfc166ffc48 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:55.513599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.515047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.515926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.516206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] PATH_INFO: `/v3/projects/b3cbb31280014851a7ef94afd2442bd3/users/67794442a8734125af8a0f94bf427567/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.538899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cbb31280014851a7ef94afd2442bd3, user_id=67794442a8734125af8a0f94bf427567, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.542236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.580314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccf864c99cb408f8263d1edc077a407'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:55.587184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccf864c99cb408f8263d1edc077a407'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:55.690803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 881/1757] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:55 2022] PUT /identity/v3/projects/b3cbb31280014851a7ef94afd2442bd3/users/67794442a8734125af8a0f94bf427567/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:55.694633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:55.727196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccf864c99cb408f8263d1edc077a407'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:55.727196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccf864c99cb408f8263d1edc077a407'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:55.741434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-35c07f73-cf92-4a06-a70e-0f3076c0d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccf864c99cb408f8263d1edc077a407'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:55.749927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 877/1758] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:54 2022] DELETE /identity/v3/users/cccf864c99cb408f8263d1edc077a407 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:03:55.754584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.754868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.755150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.783170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:55.784927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:55.802396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081db284-f3d6-4919-afb0-c746ba270c71 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:55.884717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 878/1759] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:55.885773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:55.887279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:55.915740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0cba4-a927-460b-aa3e-22cbeafbb9cf None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:55.922623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.923551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.924009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.924517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] PATH_INFO: `/v3/users/6857802102bb4b278ebf3085b6917142` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.926040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6857802102bb4b278ebf3085b6917142)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.928262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.971255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:55.971898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.972183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.972453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:55.973110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:55.974878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5b12a-8581-4995-85fd-d15fbe023b91 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:55.989905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 882/1760] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:03:55.991915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:55.992200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:55.992691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.084560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:56.094447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.227078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6857802102bb4b278ebf3085b6917142'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:56.250195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 883/1761] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:03:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:56.251487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:56.256955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.259787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6857802102bb4b278ebf3085b6917142'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:56.437016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a67c82-f5d1-446d-97a7-048b3442402a None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:56.445339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6857802102bb4b278ebf3085b6917142'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:56.445966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6857802102bb4b278ebf3085b6917142'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:56.468006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:56.468842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:56.469183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:56.469183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.481713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.483234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6857802102bb4b278ebf3085b6917142'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:56.518841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 879/1762] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:55 2022] DELETE /identity/v3/users/6857802102bb4b278ebf3085b6917142 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:56.527065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:56.529226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.544286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:56.545755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcdc55-d442-4e47-a767-b3cdcb14fef7 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:56.570583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 884/1763] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:56.572938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:56.573365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:56.573801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.603196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:56.603196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.697737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf07e-f846-486a-a6f5-8a51c144ce2e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:56.708539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 885/1764] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:56.735067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:56.735067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:56.735067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:56.735067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] PATH_INFO: `/v3/projects/b3cbb31280014851a7ef94afd2442bd3/users/67794442a8734125af8a0f94bf427567/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.740515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cbb31280014851a7ef94afd2442bd3, user_id=67794442a8734125af8a0f94bf427567, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:56.744437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:56.749805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:56.753440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.784181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 880/1765] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:03:56 2022] PUT /identity/v3/projects/b3cbb31280014851a7ef94afd2442bd3/users/67794442a8734125af8a0f94bf427567/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:56.784181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:56.786115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:56.867078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897cf7e-b584-4b59-bf8a-cc271312fd90 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:56.970487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:56.971497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:56.972065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896b62-b983-42fb-a43b-f55656845f57 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:56.976298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:56.976721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.981437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:56.982048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:56.982549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:56.983128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:56.990230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:57.097475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:57.099411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089dd3c-2850-49f8-a5db-422aeead6235 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:57.120258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 881/1766] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:03:57.125786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:57.127214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:57.129589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:57.172108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:57.173743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526b62e-5b02-4ab3-891a-74614dcb1602 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:57.178795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] MFA Rules not processed for user `67794442a8734125af8a0f94bf427567`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:57.180237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:57.193724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 886/1767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:57.379573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 882/1768] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:03:57.529087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:57.531719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:57.535660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:57.584214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:57.589494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:57.591439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:57.592483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:03:57.594013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:57.651325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 887/1769] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 1 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:03:57.676507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:57.687931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:57.719856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803ea07-61cd-46c8-875e-0b3eb5a1ce8d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:57.739496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:57.739496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:57.739496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:57.739496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:57.744365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:57.746161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:57.755976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be324697-46fb-4cfb-b2a3-ac0e8ec59f24 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:57.779897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 888/1770] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:57.786375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:57.787382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:57.787687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:57.788003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:57.813136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:57.814614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:57.843011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 883/1771] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:03:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:03:58.143403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:58.163794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:58.165937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:58.199072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e9e6-7efd-4200-9c93-f96f11fafacf service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:58.209733 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:58.213846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:58.214139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:58.215533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] PATH_INFO: `/v3/projects/7f044e93b46b4c1596dc8221c0a6e87a` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:58.225078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f044e93b46b4c1596dc8221c0a6e87a)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:58.225078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:58.650956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f044e93b46b4c1596dc8221c0a6e87a', 'request_id': 'req-d37a11d3-8afa-43f2-9238-415138e8eefa'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:58.650956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f044e93b46b4c1596dc8221c0a6e87a', 'request_id': 'req-d37a11d3-8afa-43f2-9238-415138e8eefa'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:58.782994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f044e93b46b4c1596dc8221c0a6e87a', 'request_id': 'req-d37a11d3-8afa-43f2-9238-415138e8eefa'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:58.801321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] The token cache is being invalidate because project 7f044e93b46b4c1596dc8221c0a6e87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:58.803237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:58.804077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:58.809086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 889/1772] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:58 2022] DELETE /identity/v3/projects/7f044e93b46b4c1596dc8221c0a6e87a => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:58.810565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:58.831661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:58.835399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:58.838591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d87a5-7d2d-40e6-9168-06780d5cb5bf service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:59.034668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a11d3-8afa-43f2-9238-415138e8eefa admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:03:59.051158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:59.054871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:59.054871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:59.055106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] PATH_INFO: `/v3/projects/b9ee11ed7be14e40a17d8eed0628a1e6` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:59.057452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ee11ed7be14e40a17d8eed0628a1e6)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:59.059718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:03:59.060390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:59.061159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:59.061876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:59.062902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] PATH_INFO: `/v3/users/b8cc9e693b034e3d9385da1e6b1d7934` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:59.065217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cc9e693b034e3d9385da1e6b1d7934)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:03:59.067721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:03:59.449429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cc9e693b034e3d9385da1e6b1d7934'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.597961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ee11ed7be14e40a17d8eed0628a1e6', 'request_id': 'req-1fdbd992-3ba6-4517-8313-3769c390f804'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.597961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ee11ed7be14e40a17d8eed0628a1e6', 'request_id': 'req-1fdbd992-3ba6-4517-8313-3769c390f804'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.608244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cc9e693b034e3d9385da1e6b1d7934'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.701802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ee11ed7be14e40a17d8eed0628a1e6', 'request_id': 'req-1fdbd992-3ba6-4517-8313-3769c390f804'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.740475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] The token cache is being invalidate because project b9ee11ed7be14e40a17d8eed0628a1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:03:59.741010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.743052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1fdbd992-3ba6-4517-8313-3769c390f804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.755100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 890/1773] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:03:58 2022] DELETE /identity/v3/projects/b9ee11ed7be14e40a17d8eed0628a1e6 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:03:59.760895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:03:59.761190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:03:59.761491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:03:59.763184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 891/1774] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:03:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:03:59.763832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:03:59.772807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:03:59.923981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:59.975782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cc9e693b034e3d9385da1e6b1d7934'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.975782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cc9e693b034e3d9385da1e6b1d7934'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:03:59.992916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d3b9511e-5e1c-4dfc-81ae-f35fd9104c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cc9e693b034e3d9385da1e6b1d7934'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:00.001630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8715c-7d68-4380-9be2-f9e4ed9d65d4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:00.007186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 884/1775] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:58 2022] DELETE /identity/v3/users/b8cc9e693b034e3d9385da1e6b1d7934 => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:00.010000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:00.010589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:00.011483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:00.041804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:00.044288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:00.160782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 885/1776] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:00.161891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:00.166193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:00.245051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:00.245947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:00.246357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:00.246717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] PATH_INFO: `/v3/users/1c5f9a54b4fe4117ba8e81df75c66fbd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:00.257288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5f9a54b4fe4117ba8e81df75c66fbd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:00.270179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:00.307225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1fa14-9686-42f8-8847-22495a75e644 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:00.321251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:00.321251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:00.321251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:00.321251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] PATH_INFO: `/v3/users/b870b5ae143c4104ab02446b0740bc42` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:00.321703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b870b5ae143c4104ab02446b0740bc42)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:00.321703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:00.965023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5f9a54b4fe4117ba8e81df75c66fbd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:00.965520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b870b5ae143c4104ab02446b0740bc42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:00.965631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5f9a54b4fe4117ba8e81df75c66fbd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:00.965723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b870b5ae143c4104ab02446b0740bc42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.119393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5f9a54b4fe4117ba8e81df75c66fbd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.154169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5f9a54b4fe4117ba8e81df75c66fbd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.155226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5f9a54b4fe4117ba8e81df75c66fbd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.169284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 892/1777] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:03:59 2022] DELETE /identity/v3/users/1c5f9a54b4fe4117ba8e81df75c66fbd => generated 0 bytes in 1405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:01.170397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:01.172255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:01.246203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b870b5ae143c4104ab02446b0740bc42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.248171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b870b5ae143c4104ab02446b0740bc42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.278801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b870b5ae143c4104ab02446b0740bc42'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:01.298887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 886/1778] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:00 2022] DELETE /identity/v3/users/b870b5ae143c4104ab02446b0740bc42 => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:01.300334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:01.302257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:01.367190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d59b-2d10-4fb1-a972-5f0ba32b4dcf admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:01.496690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff47d3c-60a3-4bbd-b1fb-d343a264700a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:01.512283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:01.513630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:01.513946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:01.517988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] PATH_INFO: `/v3/users/f93de4c8a0b348f08809c69a5767ff31` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:01.521694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93de4c8a0b348f08809c69a5767ff31)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:01.533237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:01.682905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:01.684511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:01.685039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:01.685475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:01.688348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:01.726141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:01.729438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118f829-6ff0-4a06-b722-a4cf07a04d02 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:01.791520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 893/1779] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:01.793400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:01.793949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:01.794234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:01.863081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:01.864600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.174433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 894/1780] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:02.174433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:02.174433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.174433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d8fa4-f641-4197-b3e1-033c6a12e77d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:02.175986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:02.175986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.175986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.175986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] PATH_INFO: `/v3/projects/ed9a5179095843bea5c688d9405a7285` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.176758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9a5179095843bea5c688d9405a7285)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:02.176758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:02.247032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93de4c8a0b348f08809c69a5767ff31'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.256628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93de4c8a0b348f08809c69a5767ff31'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.297224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:02.411375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9a5179095843bea5c688d9405a7285', 'request_id': 'req-94773b26-c167-4d11-8770-0917da1a3107'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.418952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9a5179095843bea5c688d9405a7285', 'request_id': 'req-94773b26-c167-4d11-8770-0917da1a3107'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.521311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93de4c8a0b348f08809c69a5767ff31'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.522632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93de4c8a0b348f08809c69a5767ff31'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.545939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93de4c8a0b348f08809c69a5767ff31'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.550654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 887/1781] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:01 2022] DELETE /identity/v3/users/f93de4c8a0b348f08809c69a5767ff31 => generated 0 bytes in 1251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:02.551994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:02.553906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.620541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f78f7-a627-4b76-9aaa-7c1ad2b77c43 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:02.625824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:02.630258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.653507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.654195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.657753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9a5179095843bea5c688d9405a7285', 'request_id': 'req-94773b26-c167-4d11-8770-0917da1a3107'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.657930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:02.660396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.687217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] The token cache is being invalidate because project ed9a5179095843bea5c688d9405a7285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:02.687217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.687217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-94773b26-c167-4d11-8770-0917da1a3107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:02.687217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 895/1782] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:01 2022] DELETE /identity/v3/projects/ed9a5179095843bea5c688d9405a7285 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:02.687217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.687714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.687714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.762866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:02.764249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.781766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:02.793193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6023853-98b6-4698-8d3a-0d446bfd5543 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:02.797522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 888/1783] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:02.798904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e32f-9332-4f46-bbcf-001f64170b7f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.799208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e32f-9332-4f46-bbcf-001f64170b7f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.799520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e32f-9332-4f46-bbcf-001f64170b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.849974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 896/1784] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:02.864645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8c74e32f-9332-4f46-bbcf-001f64170b7f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:02.866248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8c74e32f-9332-4f46-bbcf-001f64170b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.867152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:02.869350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.885840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 889/1785] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:02.887429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.887719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.888004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.896989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d85fff-f58c-4d4b-83b6-96ae2665a014 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:02.910364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:02.911104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:02.911504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:02.912102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:02.939335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:02.951059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:02.954026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:02.956073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:02.971012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 897/1786] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:02.990474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 890/1787] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:02.990985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:03.023841 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10979-3d2f-488e-9ca4-1745e26de45d service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:03.030210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:03.032108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:03.032801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:03.035341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:03.036634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:03.037084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:03.039114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:03.067904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 898/1788] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:03.072242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:03.084800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb626-1d62-4ae1-ad8a-0d71843972c2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:03.091497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:03.092127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:03.092415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:03.092704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:03.093323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:03.096536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:03.143980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:03.177351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:03.177351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b85595-28a4-4103-9b10-9e1954221419 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:03.178525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:03.179472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:03.179951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:03.180410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] PATH_INFO: `/v3/projects/58489e34001641ea88595cd8f64790c3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:03.182051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=58489e34001641ea88595cd8f64790c3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:03.187448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:03.414485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 891/1789] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:03 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:03.421051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:03.500214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58489e34001641ea88595cd8f64790c3', 'request_id': 'req-1d798a80-df1a-4b95-921d-b245fe5e03ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:03.525957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58489e34001641ea88595cd8f64790c3', 'request_id': 'req-1d798a80-df1a-4b95-921d-b245fe5e03ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:03.580292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee8a3-ba04-406d-860c-dc1cc006aab7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:03.694475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:03.694475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:03.694475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:03.694475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:03.694805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:03.694805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:03.844540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58489e34001641ea88595cd8f64790c3', 'request_id': 'req-1d798a80-df1a-4b95-921d-b245fe5e03ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:03.877596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] The token cache is being invalidate because project 58489e34001641ea88595cd8f64790c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:03.877980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:03.880640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1d798a80-df1a-4b95-921d-b245fe5e03ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:03.883428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 899/1790] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:03 2022] DELETE /identity/v3/projects/58489e34001641ea88595cd8f64790c3 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:03.906853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16984-ee08-46f5-8c9a-1049b1f5d061 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:03.911813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16984-ee08-46f5-8c9a-1049b1f5d061 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:03.912301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16984-ee08-46f5-8c9a-1049b1f5d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:03.918085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 892/1791] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:03 2022] POST /identity/v3/users => generated 293 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:03.919499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:03.930453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:04.016595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18fe8-7e4c-4821-ac99-2697ba2a7363 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:04.032377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b4c16984-ee08-46f5-8c9a-1049b1f5d061 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:04.077282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b4c16984-ee08-46f5-8c9a-1049b1f5d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:04.077860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:04.081389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.081890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.082387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.083567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:04.090346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:04.141325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 900/1792] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:04.141325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.141325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.141325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.174300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 893/1793] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:04.174404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:04.175681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:04.177193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:04.194802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5d3c-c6a3-4668-857a-92776b19d6c3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:04.200477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 901/1794] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:04.208270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:04.211309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:04.211938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.212281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.213163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.213833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:04.215844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:04.232158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8085d1c-7ee3-42ea-85ec-3dd55a391728 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:04.236210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 894/1795] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:04.241788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:04.242101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:04.242824 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.243622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.246425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.248288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:04.249950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:04.256184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:04.286648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 902/1796] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:04.287826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:04.304427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722753d-7fa1-47c5-8cad-f2c4aca673da admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:04.311707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:04.312790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.313157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.313484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] PATH_INFO: `/v3/projects/ae826d68ea234c3881839d2a4ae1d267/users/a093c922dcc8482bb736654b6c6e64a4/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.326653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd64fd-9233-433f-8928-5512deff5eb4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:04.334576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae826d68ea234c3881839d2a4ae1d267, user_id=a093c922dcc8482bb736654b6c6e64a4, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:04.338791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f935-b1e2-4a5e-8002-859d044af285 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:04.340917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:04.343107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.343507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.343883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.344812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:04.347407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:04.623894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 895/1797] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:04 2022] PUT /identity/v3/projects/ae826d68ea234c3881839d2a4ae1d267/users/a093c922dcc8482bb736654b6c6e64a4/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:04.629640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:04.629902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:04.630183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:04.695670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] MFA Rules not processed for user `a093c922dcc8482bb736654b6c6e64a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:04.698834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:04.880692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 903/1798] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:04 2022] POST /identity/v3/projects => generated 365 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:04.887113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:04.968485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 896/1799] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:04.974571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:05.158465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64855eb2-6263-4e80-9b9a-6c2c70bb8c4a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:05.182587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6321e-c4bc-4862-bb0d-f26d8e1e5681 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:05.187983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:05.189183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:05.189464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:05.189737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:05.190404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:05.194762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:05.202058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:05.207980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:05.208416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:05.208825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:05.209706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:05.231927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:05.594284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 904/1800] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:04 2022] POST /identity/v3/users => generated 283 bytes in 707 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:05.594529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:05.607103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:05.616612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 897/1801] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:05.623014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:05.627582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:05.675322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6dfcc-6212-48bb-9172-ad6b252ba65f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:05.932802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ed19-98c2-4792-aa35-432a000d91b1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:05.934187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:05.934187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:05.934187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:05.934187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] PATH_INFO: `/v3/projects/99cf65aa3bd348cebc6562961c1b6f7c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:05.934704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:05.934704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:05.934704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:05.934704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] PATH_INFO: `/v3/projects/8c57f2c6fd01460fa95ab93bfac17ce1` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:05.935019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99cf65aa3bd348cebc6562961c1b6f7c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:05.935099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c57f2c6fd01460fa95ab93bfac17ce1)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:05.935191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:05.935284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:06.410253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c57f2c6fd01460fa95ab93bfac17ce1', 'request_id': 'req-ac446b7d-6d36-4ed6-bc44-167b053f4236'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.418062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99cf65aa3bd348cebc6562961c1b6f7c', 'request_id': 'req-fe27c6e2-b332-4962-8f30-62c38205bcc3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.418577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c57f2c6fd01460fa95ab93bfac17ce1', 'request_id': 'req-ac446b7d-6d36-4ed6-bc44-167b053f4236'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.419320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99cf65aa3bd348cebc6562961c1b6f7c', 'request_id': 'req-fe27c6e2-b332-4962-8f30-62c38205bcc3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.425900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c57f2c6fd01460fa95ab93bfac17ce1', 'request_id': 'req-ac446b7d-6d36-4ed6-bc44-167b053f4236'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.539095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99cf65aa3bd348cebc6562961c1b6f7c', 'request_id': 'req-fe27c6e2-b332-4962-8f30-62c38205bcc3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.607064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] The token cache is being invalidate because project 99cf65aa3bd348cebc6562961c1b6f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:06.609165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.626704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.631951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 905/1802] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:05 2022] DELETE /identity/v3/projects/99cf65aa3bd348cebc6562961c1b6f7c => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:06.631951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:06.631951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:06.814233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27c6e2-b332-4962-8f30-62c38205bcc3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:06.902116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:06.902780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:06.907273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:06.907273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:06.907273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:06.907273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:06.920480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 906/1803] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:06.920480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:06.921980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:06.931412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] The token cache is being invalidate because project 8c57f2c6fd01460fa95ab93bfac17ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:06.931967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.933052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ac446b7d-6d36-4ed6-bc44-167b053f4236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:06.935064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 898/1804] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:05 2022] DELETE /identity/v3/projects/8c57f2c6fd01460fa95ab93bfac17ce1 => generated 0 bytes in 1318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:06.936117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:06.936397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:06.936671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:06.938161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 899/1805] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:04:06.938965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:06.940822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:06.945114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52f94-35ad-4fcd-be52-2250571eb8d5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:06.951408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:06.952216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:06.952647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:06.953127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:06.953915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:06.956146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:06.974054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cec5cd-82bb-42ba-943a-30bf38cd6433 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:06.979584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:06.980403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:06.980944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:06.981254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] PATH_INFO: `/v3/users/b1f742316f524fffb3b284a08beefece` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:06.982452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f742316f524fffb3b284a08beefece)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:06.984435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:07.172987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 907/1806] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:06 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:07.174164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:07.178619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:07.208922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0315-7d84-46e4-864a-a27309a55cb4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:07.221148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:07.221770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:07.222224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:07.222657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:07.223499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:07.230674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:07.253853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 908/1807] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:07.255012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:07.256999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:07.273002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6c92-3837-4ae4-90d8-0fdbfd5a3bdc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:07.279521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:07.280399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:07.280867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:07.281270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] PATH_INFO: `/v3/users/67794442a8734125af8a0f94bf427567` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:07.283959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67794442a8734125af8a0f94bf427567)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:07.287425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:07.389969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f742316f524fffb3b284a08beefece'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.404494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f742316f524fffb3b284a08beefece'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.577064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f742316f524fffb3b284a08beefece'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.582944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f742316f524fffb3b284a08beefece'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.596192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e3f09023-4f2f-46f3-b629-231a6ad7dba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f742316f524fffb3b284a08beefece'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.603781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 900/1808] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:06 2022] DELETE /identity/v3/users/b1f742316f524fffb3b284a08beefece => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:07.611755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:07.611755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:07.611755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:07.633670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:07.636113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:07.660596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67794442a8734125af8a0f94bf427567'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.677257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67794442a8734125af8a0f94bf427567'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:07.754560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 901/1809] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:04:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:07.757114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:07.758656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:07.866642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032774d7-2c05-4a6c-ac09-9f1dc972c401 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:07.871790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:07.872410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:07.872802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:07.873076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:07.873731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:07.875662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:07.888820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 902/1810] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:07.889743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:07.892295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:07.937797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbfab2-17fa-45f0-828e-c288c16a9c3c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:07.937797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:07.937797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:07.937797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:07.938774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] PATH_INFO: `/v3/projects/63eab457b88243d488deebd79b5836bd/users/8dac234de37b49938c60249a9417a190/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:07.952776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63eab457b88243d488deebd79b5836bd, user_id=8dac234de37b49938c60249a9417a190, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:07.956759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.028645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67794442a8734125af8a0f94bf427567'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:08.070617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67794442a8734125af8a0f94bf427567'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:08.072913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67794442a8734125af8a0f94bf427567'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:08.094451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 909/1811] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:07 2022] DELETE /identity/v3/users/67794442a8734125af8a0f94bf427567 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:08.111391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:08.120184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:08.169278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 903/1812] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:07 2022] PUT /identity/v3/projects/63eab457b88243d488deebd79b5836bd/users/8dac234de37b49938c60249a9417a190/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:08.171403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:08.182902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:08.340625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff414c-30b5-4d57-9183-a927280cd36b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:08.399062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099c0e8-535f-4e12-8639-4d0410597b83 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:08.418327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:08.419586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.419586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.419813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] PATH_INFO: `/v3/projects/21944ffd501f4003a052e6488207187f/users/dbc6dec1f8284e3dbfa152f0e8866c9c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.474291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:08.478555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.478555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.478555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.479523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:08.484253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21944ffd501f4003a052e6488207187f, user_id=dbc6dec1f8284e3dbfa152f0e8866c9c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:08.492476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.497565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:08.513967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47618a-0740-47cf-bbc1-5bfa1438071a service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.527388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 910/1813] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:08.529438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.529438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.529831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.559162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:08.613195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] MFA Rules not processed for user `8dac234de37b49938c60249a9417a190`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:08.615337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:08.673516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 904/1814] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:08 2022] PUT /identity/v3/projects/21944ffd501f4003a052e6488207187f/users/dbc6dec1f8284e3dbfa152f0e8866c9c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:08.678471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:08.780734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72388ae3-853e-4dd7-8977-953900afb0b3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:08.785782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:08.786412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.787392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.787640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.788411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:08.791445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.794942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:08.807582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 911/1815] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:08.808353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 905/1816] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:08.826936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:08.827262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:08.827262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:08.841183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb49aa-3aae-446a-a9a2-0bbf022eb828 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:08.953057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6940c19-f46c-492c-8c00-567a0f1843c9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:08.954337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:08.954337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.954337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.954337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] PATH_INFO: `/v3/projects/21944ffd501f4003a052e6488207187f/users/dbc6dec1f8284e3dbfa152f0e8866c9c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.955072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21944ffd501f4003a052e6488207187f, user_id=dbc6dec1f8284e3dbfa152f0e8866c9c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:08.955165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:08.955165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.955165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.955165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.955494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:08.955494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.955646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4043722-de80-4458-ac4c-416af4a32dbc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:08.955646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 906/1817] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:08 2022] PUT /identity/v3/projects/21944ffd501f4003a052e6488207187f/users/dbc6dec1f8284e3dbfa152f0e8866c9c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:08.955646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:08.955646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:08.955646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:08.971990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] MFA Rules not processed for user `dbc6dec1f8284e3dbfa152f0e8866c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:08.973258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.050293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 907/1818] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:09.061690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.063183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.122083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406409c1-7dec-47c3-a1d1-09b6485bb3f7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.126133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.126776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.127059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.127330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.140005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.141476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:09.154886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 908/1819] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:09.155899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.157174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.210347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 912/1820] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:08 2022] POST /identity/v3/projects => generated 365 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:09.211975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.223333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.280300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ca31-9f0b-440f-92ca-9064e289f84a service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.303099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966750-104b-46ab-9b99-4b6c472f8211 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.309074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.310152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.310152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.310393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] PATH_INFO: `/v3/projects/b3cbb31280014851a7ef94afd2442bd3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.311695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cbb31280014851a7ef94afd2442bd3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.313562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:09.348710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.348710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.348710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.348710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] PATH_INFO: `/v3/projects/271ebb79db7b48b485bda05774e27517` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.349429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271ebb79db7b48b485bda05774e27517)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.351386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:09.453050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cbb31280014851a7ef94afd2442bd3', 'request_id': 'req-ab9229de-1d19-43eb-87e4-c7326f330f89'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.459173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cbb31280014851a7ef94afd2442bd3', 'request_id': 'req-ab9229de-1d19-43eb-87e4-c7326f330f89'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.486269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271ebb79db7b48b485bda05774e27517', 'request_id': 'req-9831002a-4a05-40da-b99b-3fb7fd5e0f60'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.493224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271ebb79db7b48b485bda05774e27517', 'request_id': 'req-9831002a-4a05-40da-b99b-3fb7fd5e0f60'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.499406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271ebb79db7b48b485bda05774e27517', 'request_id': 'req-9831002a-4a05-40da-b99b-3fb7fd5e0f60'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.596008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cbb31280014851a7ef94afd2442bd3', 'request_id': 'req-ab9229de-1d19-43eb-87e4-c7326f330f89'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.604704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] The token cache is being invalidate because project b3cbb31280014851a7ef94afd2442bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:09.605049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.605737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.607465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 913/1821] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:09 2022] DELETE /identity/v3/projects/b3cbb31280014851a7ef94afd2442bd3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:09.608132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.609584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.677343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9229de-1d19-43eb-87e4-c7326f330f89 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.734634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.735188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.735462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.735726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.736347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.738247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5cd95-e4f7-4cd9-a6c6-ea2b9a45e652 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:09.751880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] The token cache is being invalidate because project 271ebb79db7b48b485bda05774e27517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:09.756224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.756224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:09.756224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 909/1822] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:09 2022] DELETE /identity/v3/projects/271ebb79db7b48b485bda05774e27517 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:09.756224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.756794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.769503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831002a-4a05-40da-b99b-3fb7fd5e0f60 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.774039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.774772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.775057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.775327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] PATH_INFO: `/v3/users/a093c922dcc8482bb736654b6c6e64a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.776469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a093c922dcc8482bb736654b6c6e64a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.778362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:09.934107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 914/1823] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:09 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:09.939348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.939348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.939348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.956900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:09.958238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.968447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 915/1824] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:09.969091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:09.970376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:09.983404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1e79-aa42-4e63-81b2-df48d72e0f15 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:09.988411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:09.989080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:09.989358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:09.989628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] PATH_INFO: `/v3/users/025858c45fea4ce78b5d015cb86acd3d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:09.990772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025858c45fea4ce78b5d015cb86acd3d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:09.992894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.072485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a093c922dcc8482bb736654b6c6e64a4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.080099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a093c922dcc8482bb736654b6c6e64a4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.138085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a093c922dcc8482bb736654b6c6e64a4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.139307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a093c922dcc8482bb736654b6c6e64a4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.156990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a093c922dcc8482bb736654b6c6e64a4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.164307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 910/1825] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:09 2022] DELETE /identity/v3/users/a093c922dcc8482bb736654b6c6e64a4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:10.165783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.167119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.202101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025858c45fea4ce78b5d015cb86acd3d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.209117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025858c45fea4ce78b5d015cb86acd3d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.231612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3e95-8167-4c39-a4c5-4e1a35fa6659 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.236177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.236772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.237103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.237325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.237961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.239581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086ab6f-489f-41b1-a3a8-cc01cbff2ab7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.249796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 911/1826] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:10.251108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707db2ee-975c-4701-9427-46a0d778acc0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.251388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707db2ee-975c-4701-9427-46a0d778acc0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.251657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707db2ee-975c-4701-9427-46a0d778acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.271900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-707db2ee-975c-4701-9427-46a0d778acc0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:10.273218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-707db2ee-975c-4701-9427-46a0d778acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.282356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 912/1827] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:10.283640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.283919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.284185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.292598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025858c45fea4ce78b5d015cb86acd3d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.304402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:10.305607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.306550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025858c45fea4ce78b5d015cb86acd3d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.307919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025858c45fea4ce78b5d015cb86acd3d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.317610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 913/1828] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:10.317610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.325004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 916/1829] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:09 2022] DELETE /identity/v3/users/025858c45fea4ce78b5d015cb86acd3d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:10.326196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.327658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.338014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.357467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47881f0-43df-4655-b9f9-1f2e6f74817b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.463102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383e464-da27-41a9-8c6a-4ef38ff3dba0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.464419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.465443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.465925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.468000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] PATH_INFO: `/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429/users/9cbe5cb5170246cdb663b47dc13d1598/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.476866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.479522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.479847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.480119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.480807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:10.482991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.484905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.488653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cbd67ca65144cd9ff3ca6e160ca429, user_id=9cbe5cb5170246cdb663b47dc13d1598, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.491550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.505340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 917/1830] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:10.505340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.511090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.566949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d0d5-c91b-4a4e-b643-16a40ab70256 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.571003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.572963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.573250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.573550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.583754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.585211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.596112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 918/1831] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:10.599645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.600973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:10.613580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbcb53-5c36-4690-b869-b6ebb13b74a2 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.624701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.624701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.624701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.624701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] PATH_INFO: `/v3/users/2fbe773070f049d184b593600390f396` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.626523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbe773070f049d184b593600390f396)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.629019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.635271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 914/1832] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:10 2022] PUT /identity/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429/users/9cbe5cb5170246cdb663b47dc13d1598/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:10.636486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.713891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b3931-4023-4962-ac1d-89bee030453d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.718814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.719429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.719710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.719985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.720652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.722988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.880227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 915/1833] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:10 2022] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:10.881485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:10.946490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbe773070f049d184b593600390f396'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.960840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbe773070f049d184b593600390f396'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:10.974688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808081-7554-4fd9-9eed-0216b2796386 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:10.981304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:10.981895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:10.982204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:10.982471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:10.983488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:10.985095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:10.995755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 916/1834] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:10.996573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.006108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab63d1a-38eb-4bf5-9a67-ed35443d8acd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.011904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.018959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.018959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.018959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.018959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.018959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.045045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbe773070f049d184b593600390f396'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.059118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbe773070f049d184b593600390f396'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.059947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbe773070f049d184b593600390f396'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.066305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 919/1835] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:10 2022] DELETE /identity/v3/users/2fbe773070f049d184b593600390f396 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:11.070102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.072324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.139329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b35d-c451-413d-b764-c58abe142f53 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.146381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 917/1836] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:10 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:11.146381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.146381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.148671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.150164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.151010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.151010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] PATH_INFO: `/v3/projects/6089195451964d7e9dea1853053c7ab5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.152242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6089195451964d7e9dea1853053c7ab5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.154174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.162176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021304-572e-4f53-b636-5b6e8d6981f4 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.168342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.169142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.169531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.169907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] PATH_INFO: `/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429/users/9cbe5cb5170246cdb663b47dc13d1598/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.175718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cbd67ca65144cd9ff3ca6e160ca429, user_id=9cbe5cb5170246cdb663b47dc13d1598, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.175718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7313f3-35af-4daf-b3b1-50ac13c3aeff admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.188579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 918/1837] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:11 2022] PUT /identity/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429/users/9cbe5cb5170246cdb663b47dc13d1598/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:11.189798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.190079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.190351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.213761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:11.215017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.279545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 919/1838] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:11.280431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.284893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.298084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943f99b-0d42-4752-a4da-1ea8e00b1d6e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.301968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6089195451964d7e9dea1853053c7ab5', 'request_id': 'req-1a0b26ae-2f9f-4c41-872c-6421600f61a9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.308680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6089195451964d7e9dea1853053c7ab5', 'request_id': 'req-1a0b26ae-2f9f-4c41-872c-6421600f61a9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.359517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.360134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.360438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.360798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.361447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.363105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f287-c0aa-4e0a-a256-76cada211a26 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.373022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 920/1839] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:11.374416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.374703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.375009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.408347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] MFA Rules not processed for user `9cbe5cb5170246cdb663b47dc13d1598`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:11.409576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.435748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6089195451964d7e9dea1853053c7ab5', 'request_id': 'req-1a0b26ae-2f9f-4c41-872c-6421600f61a9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.448910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] The token cache is being invalidate because project 6089195451964d7e9dea1853053c7ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:11.449208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.450139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.456057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 920/1840] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:11 2022] DELETE /identity/v3/projects/6089195451964d7e9dea1853053c7ab5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:11.456057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.457485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.472082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b26ae-2f9f-4c41-872c-6421600f61a9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.482234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.482234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.482234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.482234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] PATH_INFO: `/v3/projects/ae826d68ea234c3881839d2a4ae1d267` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.482650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae826d68ea234c3881839d2a4ae1d267)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.482650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.486013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 921/1841] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:11.487229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.488578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.562800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f0c09-0ae8-43da-9c45-636d955b08d3 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.565189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.565799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.566079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.566350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.568217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.581252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.582716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.594133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 922/1842] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:11.595007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.596469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.601500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae826d68ea234c3881839d2a4ae1d267', 'request_id': 'req-22603add-a9ff-4f04-936f-414a769ae63a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.608044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae826d68ea234c3881839d2a4ae1d267', 'request_id': 'req-22603add-a9ff-4f04-936f-414a769ae63a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.609049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51d15-0b92-4493-9a30-f8d3c901787b service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.674876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.675500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.675782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.676060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.676714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.678556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961054-6721-4167-8613-33ab69c5b9f3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.699524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 923/1843] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:11.700851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.701141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.701423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.726097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:11.727427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.737504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 924/1844] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:11.738366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.744803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.753754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae826d68ea234c3881839d2a4ae1d267', 'request_id': 'req-22603add-a9ff-4f04-936f-414a769ae63a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.767981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] The token cache is being invalidate because project ae826d68ea234c3881839d2a4ae1d267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:11.768232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.768904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:11.770653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 921/1845] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:11 2022] DELETE /identity/v3/projects/ae826d68ea234c3881839d2a4ae1d267 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:11.771604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.772903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.786028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603add-a9ff-4f04-936f-414a769ae63a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.791631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.792299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.792580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.792851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] PATH_INFO: `/v3/projects/e3d1fe1ff08949aabf55da335eeb066c/users/db3aa0724b0744a5850ffdd054abeca4/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.808641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d1fe1ff08949aabf55da335eeb066c, user_id=db3aa0724b0744a5850ffdd054abeca4, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.811335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.814257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30be88-17a0-47cd-be9c-bed0a40c24a6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.817777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83580ec-d478-472e-b855-429763558961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.818369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83580ec-d478-472e-b855-429763558961 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.818643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83580ec-d478-472e-b855-429763558961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.818943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83580ec-d478-472e-b855-429763558961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.820662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e83580ec-d478-472e-b855-429763558961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.882900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83580ec-d478-472e-b855-429763558961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.884614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83580ec-d478-472e-b855-429763558961 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.894147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 925/1846] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:11.895388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.895766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.896043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.925614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:11.926997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.939142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 926/1847] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:11.939981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:11.941397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:11.953694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9178-57ef-4088-abd4-57bf2a06b947 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:11.961823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:11.963233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:11.963371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:11.963655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] PATH_INFO: `/v3/users/dbc6dec1f8284e3dbfa152f0e8866c9c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:11.964855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc6dec1f8284e3dbfa152f0e8866c9c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:11.966711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:11.994073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 922/1848] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:11 2022] PUT /identity/v3/projects/e3d1fe1ff08949aabf55da335eeb066c/users/db3aa0724b0744a5850ffdd054abeca4/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:12.003081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.087882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9a43-a67f-4e11-84f0-3fb3104e2ad3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.087882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.087882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.087882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.088400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.088400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:12.088400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.088400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc4d9-1de8-437f-a3bf-4d3a1abaa21a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.101317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 923/1849] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:12.101317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.101317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.101317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.131809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] MFA Rules not processed for user `db3aa0724b0744a5850ffdd054abeca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:12.133078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.209197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 924/1850] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:12.209197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.228459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926d63f-b47f-4095-8ae3-9293739e1019 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.228847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.229464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.229742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.230008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.230889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.233415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.235405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc6dec1f8284e3dbfa152f0e8866c9c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.245857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc6dec1f8284e3dbfa152f0e8866c9c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.370837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc6dec1f8284e3dbfa152f0e8866c9c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.371967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc6dec1f8284e3dbfa152f0e8866c9c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.378632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 925/1851] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:12 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:12.381055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.383293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.387195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc6dec1f8284e3dbfa152f0e8866c9c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.393824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 927/1852] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:11 2022] DELETE /identity/v3/users/dbc6dec1f8284e3dbfa152f0e8866c9c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:12.394449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.395791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.468829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b4825-18ae-4d38-82b7-6c83e75691d6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.471412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50572d-3aa6-4a9d-89b2-e84f6f2a12d0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.475682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.476400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.476718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.476948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.479294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.531222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.531846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.532128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.532399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.533033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.535013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.545944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.547421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.556316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 928/1853] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:12.557288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.558547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.572124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd4066-c134-48c3-9902-3b7abe88fac3 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.577055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.577644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.577921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.578185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.578830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.580749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.629626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 926/1854] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:12 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:12.636479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.636479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:12.703705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55722b80-dd8d-4ab1-b29a-7a45bd9ea0fa admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.709432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:12.715743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.716851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.716851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.717019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] PATH_INFO: `/v3/projects/3f6c5131dd1749c5a39e0225a02c8304` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.718382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6c5131dd1749c5a39e0225a02c8304)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.720545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 929/1855] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:12 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:12.720882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.721401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.732690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451419e3-49f2-4d64-860d-9d10eccfd9af admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.738426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.739088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.739251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.739469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.740101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.742191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:12.883740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 930/1856] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:12 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:12.883740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:12.900548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ed7f1-b0a5-48b6-96d9-f4ff2be1afb1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:12.903075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6c5131dd1749c5a39e0225a02c8304', 'request_id': 'req-1ebc719b-e975-4894-aa0d-2a7c990c00ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.910126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6c5131dd1749c5a39e0225a02c8304', 'request_id': 'req-1ebc719b-e975-4894-aa0d-2a7c990c00ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:12.986173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:12.986831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:12.987112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:12.987455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:12.988168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:12.989859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.000484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 931/1857] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:13.001308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.012801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f570-d1c9-4217-bc84-877f732ad842 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.018080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.020460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.020460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.020460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.020733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.022263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.033412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 932/1858] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:13.034178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.036023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.044950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6c5131dd1749c5a39e0225a02c8304', 'request_id': 'req-1ebc719b-e975-4894-aa0d-2a7c990c00ed'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.050055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4446f7-632f-427b-85db-592d7b20e567 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.056495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.056495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.056495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.056495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] PATH_INFO: `/v3/projects/21944ffd501f4003a052e6488207187f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.056875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] The token cache is being invalidate because project 3f6c5131dd1749c5a39e0225a02c8304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:13.056875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.057577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.057893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21944ffd501f4003a052e6488207187f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.062212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 927/1859] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:12 2022] DELETE /identity/v3/projects/3f6c5131dd1749c5a39e0225a02c8304 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.062212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.062435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.063337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.077695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc719b-e975-4894-aa0d-2a7c990c00ed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.082558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.083263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.083584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.083922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.084634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.086277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.097291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 928/1860] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:13.098107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.099742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.112248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ea2dd-044f-4d87-9d1d-077c7201b512 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.116901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.117533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.117859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.118146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] PATH_INFO: `/v3/projects/797fef3a43d54404bc46394ca7b37715/users/a9a995b00ad44505b9b6c003dd2ed60c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.132795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797fef3a43d54404bc46394ca7b37715, user_id=a9a995b00ad44505b9b6c003dd2ed60c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.135920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.250306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 929/1861] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:13 2022] PUT /identity/v3/projects/797fef3a43d54404bc46394ca7b37715/users/a9a995b00ad44505b9b6c003dd2ed60c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.251202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.257085 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.257208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21944ffd501f4003a052e6488207187f', 'request_id': 'req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.264930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21944ffd501f4003a052e6488207187f', 'request_id': 'req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.270964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21944ffd501f4003a052e6488207187f', 'request_id': 'req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.317722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f0649-30f3-46a4-9120-a089cb825542 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.323008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.323672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.323958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.324240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] PATH_INFO: `/v3/users/632b552cb3034ee688f6cb631b3761ac` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.325661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632b552cb3034ee688f6cb631b3761ac)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.327620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.364811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] The token cache is being invalidate because project 21944ffd501f4003a052e6488207187f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:13.365106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.365755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.367972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 933/1862] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:13 2022] DELETE /identity/v3/projects/21944ffd501f4003a052e6488207187f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.369297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.370537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.435279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f20cd-2d32-40e5-b677-4b96ab3023b6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.440197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.440855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.441135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.441551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] PATH_INFO: `/v3/projects/7d2b530a389a4c4e98b24c182b0a764e/users/d0451e6698644697b874d52592394b54/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.458650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2b530a389a4c4e98b24c182b0a764e, user_id=d0451e6698644697b874d52592394b54, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.461662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.578959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 934/1863] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:13 2022] PUT /identity/v3/projects/7d2b530a389a4c4e98b24c182b0a764e/users/d0451e6698644697b874d52592394b54/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.580012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.582004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.595112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632b552cb3034ee688f6cb631b3761ac'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.602077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632b552cb3034ee688f6cb631b3761ac'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.650702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ae15-9ee2-4862-9ed3-e0faef2b69b4 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.656538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.657097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.657381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.657657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.658308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.660010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ce27e-86dc-4f22-8318-049f7233d176 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.673285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 935/1864] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:13.674502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606994f7-0eaa-4aee-bf47-bc4c088d6712 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.674818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606994f7-0eaa-4aee-bf47-bc4c088d6712 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.675101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606994f7-0eaa-4aee-bf47-bc4c088d6712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.695759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-606994f7-0eaa-4aee-bf47-bc4c088d6712 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:13.698034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-606994f7-0eaa-4aee-bf47-bc4c088d6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.706512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 936/1865] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:13.707709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882881-5cc2-437b-a70d-6b56c63caa4d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.707995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882881-5cc2-437b-a70d-6b56c63caa4d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.719522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882881-5cc2-437b-a70d-6b56c63caa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.736522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3e882881-5cc2-437b-a70d-6b56c63caa4d None None] MFA Rules not processed for user `d0451e6698644697b874d52592394b54`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:13.737743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3e882881-5cc2-437b-a70d-6b56c63caa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.746702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632b552cb3034ee688f6cb631b3761ac'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.762870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632b552cb3034ee688f6cb631b3761ac'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.764159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632b552cb3034ee688f6cb631b3761ac'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:13.772438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 930/1866] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:13 2022] DELETE /identity/v3/users/632b552cb3034ee688f6cb631b3761ac => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.773333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.783107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.813430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 937/1867] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:13.814720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.815082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.815362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.840277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:13.842250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.891372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed3d0f-1c7d-4a45-890d-9e86f3d3ea03 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:13.896096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:13.897053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:13.897053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:13.899811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] PATH_INFO: `/v3/projects/797fef3a43d54404bc46394ca7b37715/users/a9a995b00ad44505b9b6c003dd2ed60c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:13.899811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797fef3a43d54404bc46394ca7b37715, user_id=a9a995b00ad44505b9b6c003dd2ed60c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:13.902315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:13.912684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 931/1868] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:13 2022] PUT /identity/v3/projects/797fef3a43d54404bc46394ca7b37715/users/a9a995b00ad44505b9b6c003dd2ed60c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:13.913580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.915706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:13.917173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 938/1869] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:13.921257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:13.930374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b68b1-04d1-4bb5-b51e-fbe3d1fe0f28 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.034245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.043252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28a6d-e658-42ae-aa05-fe64060b802e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.043934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2717eb-4be2-4713-8c35-ef0ba223c5d2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.048536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.049351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.049430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.049852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.050541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.052572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.056921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 939/1870] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:04:14.058537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.058862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.059144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.069554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:14.096164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] MFA Rules not processed for user `a9a995b00ad44505b9b6c003dd2ed60c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:14.097510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.176982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 940/1871] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:14.178174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.182480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 932/1872] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:13 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:14.188798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.202400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147498a-db02-4ec8-a528-c9b34fadd476 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.282667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.283464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.284104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.284493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.285962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.288481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.291254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ca79-5659-43a2-869f-cf507256d9bc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.300323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.300323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.300323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.300323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.300603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.300676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.431206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 933/1873] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:14.433483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.439957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 941/1874] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/projects => generated 365 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:14.440888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.443795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.450117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.522047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adde03-3492-44fb-9851-576a500f574c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.544114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a9ef8-3022-4c3f-9cb4-64268a9f2256 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.555739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.556645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.557291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.557707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] PATH_INFO: `/v3/projects/786ab145abc14e90b22d987ae37db52f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.559697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786ab145abc14e90b22d987ae37db52f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.562031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.577254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.578074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.578310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.578588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.653614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.655100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.672513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 934/1875] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:14.673383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.701933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fca1d-d7c6-4078-b818-08946a625f75 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.701933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.701933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.701933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.702290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.702290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.702290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.709998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 935/1876] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:14.710704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.723062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa43882-67bc-4f49-b1a7-53a49b311502 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.735716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786ab145abc14e90b22d987ae37db52f', 'request_id': 'req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:14.744891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786ab145abc14e90b22d987ae37db52f', 'request_id': 'req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:14.753767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786ab145abc14e90b22d987ae37db52f', 'request_id': 'req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:14.825455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.826380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.826873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.827033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.827722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.829834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918caf-991b-4ae2-ad5a-57c285e784b8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.851134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] The token cache is being invalidate because project 786ab145abc14e90b22d987ae37db52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:14.854431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:14.854431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:14.854431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 942/1877] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:14 2022] DELETE /identity/v3/projects/786ab145abc14e90b22d987ae37db52f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:14.854431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.855722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.868636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f152b6-ae38-45a8-8ca1-69f0d6b7c621 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.873408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.874048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.874324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.874595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] PATH_INFO: `/v3/projects/2360d56b165540298679146115c027e7/users/672772782af04965b26f93a59505b3fe/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.890405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360d56b165540298679146115c027e7, user_id=672772782af04965b26f93a59505b3fe, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.894496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.923173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 936/1878] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:14.923173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.923173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.923173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.943337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:14.944775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.957992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 937/1879] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:14.957992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:14.957992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:14.972519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01f7d-f44f-43ed-ad83-61ad97b0eb3d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:14.977190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:14.977853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.978128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.978398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:14.979072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:14.980669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e658e5c-fc47-4b36-a88c-48120439eef9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:14.990786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 938/1880] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:14.992042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:14.992324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:14.992598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.010368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 943/1881] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:14 2022] PUT /identity/v3/projects/2360d56b165540298679146115c027e7/users/672772782af04965b26f93a59505b3fe/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:15.014794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.014896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:15.014896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.073506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d2e3-9e9e-4d16-9af5-6ff489c8e0d1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.075052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 939/1882] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:15.075889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.082991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.083608 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.083892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.084170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.084829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.085473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de4f5-f4ac-4590-a244-2f0da6bc559c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.086451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.092727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.094631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.096708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.096708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.096708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.097329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 944/1883] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:15.097434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.098145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.111456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05c901-57a5-4323-8bc7-1811a8b34863 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.112695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 940/1884] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:15.113731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.126273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a22bd-d596-4b8d-9774-5c42b63dab28 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.132239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:15.134589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.135522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.135797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.135922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.136182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.136769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:15.136878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.137077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.137240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.137579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] PATH_INFO: `/v3/projects/61478a17a673434cad388ce84b80a49c/users/d32fa1efe367426f8d5af3508d3117a6/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.138795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.155932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 945/1885] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:15.156486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61478a17a673434cad388ce84b80a49c, user_id=d32fa1efe367426f8d5af3508d3117a6, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.159442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.160602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.175280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d72e1-93d8-4dae-ae63-816fd8e0c988 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.186852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.186852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.186852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.186852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] PATH_INFO: `/v3/projects/2360d56b165540298679146115c027e7/users/672772782af04965b26f93a59505b3fe/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.188164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360d56b165540298679146115c027e7, user_id=672772782af04965b26f93a59505b3fe, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.188164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.239342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 946/1886] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:15 2022] PUT /identity/v3/projects/2360d56b165540298679146115c027e7/users/672772782af04965b26f93a59505b3fe/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:15.239342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.349445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0694-203c-4844-9c7e-cd7e79cbda59 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.349445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.349445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.349445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.350469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.350469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.350469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59799322-5422-4466-8a6e-d16c7effbae3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.434602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 941/1887] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:15 2022] PUT /identity/v3/projects/61478a17a673434cad388ce84b80a49c/users/d32fa1efe367426f8d5af3508d3117a6/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:15.434602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.435066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.500835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bd721-caba-4ca8-884e-045fe98d0674 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.504140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.507518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.507518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.507518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.507518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.532411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 947/1888] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:15 2022] POST /identity/v3/projects => generated 391 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:15.534095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.535471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.535857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.571618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] MFA Rules not processed for user `672772782af04965b26f93a59505b3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:15.573431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.583273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.584881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd96c-74a4-47ea-85d5-e6c61118c189 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.595752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 942/1889] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:15.597000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.597363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.597707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.629808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] MFA Rules not processed for user `d32fa1efe367426f8d5af3508d3117a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:15.631228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.703526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 948/1890] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:15.703526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.718091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 943/1891] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:15.722371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.781003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa38dc-c740-4bfd-b0cc-b207f1c7e23f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.785878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.786499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.786809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.787092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.787733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.788049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed00e8-53b1-4b64-a2dc-9ef8e0a214e4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:15.789681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.793835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:15.794442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:15.794740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:15.795025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:15.795652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:15.797549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:15.971098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 944/1892] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:15 2022] POST /identity/v3/projects => generated 367 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:15.972226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.973284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 949/1893] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:15 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:15.974583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:15.975767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:15.985913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827d02-a439-4005-a5da-cc6c2e934ab9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.037012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6273c-baf9-433b-a7cc-fc7cc92d16c7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.041058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.041667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.041945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.042219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.048903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.049660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.049955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.050219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.050912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.052517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.062599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 950/1894] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:16.067070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.073484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dc124-d969-4f3c-af34-2cf2aecbd740 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.078510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.079133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.079414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.079685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.080313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.082221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.103501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.106689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.114830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 945/1895] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:16.115640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.125243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc469-cd85-4fe1-9dca-abf50b84604b service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.130220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.131083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.131730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.131730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.132144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.134720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.145454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 946/1896] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:16.150427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.160121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68cb28-620b-42c6-a1d5-bd5f349db32c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.164808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.165553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.165943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.166228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] PATH_INFO: `/v3/projects/53ed0ed0fc2e49efa76375bd4cf0c7de/users/dac6a2a472294832b1dcb6e2487ed39d/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.174657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 951/1897] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:16 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:16.175957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.183016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ed0ed0fc2e49efa76375bd4cf0c7de, user_id=dac6a2a472294832b1dcb6e2487ed39d, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.185669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ca038-1dfd-4355-b83f-fc4e38dffb26 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.186258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7614d-a81e-4762-a403-2c2774375318 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.190908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.191506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.191791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.192057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.192723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.194351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.204803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 952/1898] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:16.208922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.221036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f18fc-68da-46af-b77f-29b920ceee4a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.226878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.227398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.227707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.228446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] PATH_INFO: `/v3/projects/449535adaee5416b8bffa9b50c24096c/users/c4848deaa1474344adf0908d6ae629e3/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.251796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=449535adaee5416b8bffa9b50c24096c, user_id=c4848deaa1474344adf0908d6ae629e3, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.255008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.303138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:16.309851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 947/1899] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:16 2022] PUT /identity/v3/projects/53ed0ed0fc2e49efa76375bd4cf0c7de/users/dac6a2a472294832b1dcb6e2487ed39d/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:16.318925 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.319218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.319489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.349729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] MFA Rules not processed for user `dac6a2a472294832b1dcb6e2487ed39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:16.351048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:16.373601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 953/1900] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:16 2022] PUT /identity/v3/projects/449535adaee5416b8bffa9b50c24096c/users/c4848deaa1474344adf0908d6ae629e3/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:16.374488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.419611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 948/1901] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:16.422586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.445311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2916-3c30-4545-9780-9684f00e0abc admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.450266 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.450906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.451183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.451492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.453349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:16.501757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b883c-bdfa-44dc-b369-612056d88ff7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.514979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.516477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.526495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 954/1902] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:16.527337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.569359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.570231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.570439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.570711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.571969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.573920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.586938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 949/1903] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:16.591560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.596961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89573-9c2d-4426-9b3f-a6468fa2ca7d service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.601901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.602646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.604441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.604441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.605189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.607585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.608353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0b798-bfe1-4269-9344-4451a3d11a35 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.614275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.615182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.616183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.616526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] PATH_INFO: `/v3/projects/449535adaee5416b8bffa9b50c24096c/users/c4848deaa1474344adf0908d6ae629e3/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.619502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449535adaee5416b8bffa9b50c24096c, user_id=c4848deaa1474344adf0908d6ae629e3, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.623434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cc476-9f3e-4809-9a67-51562559aca7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.639811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 950/1904] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:16 2022] PUT /identity/v3/projects/449535adaee5416b8bffa9b50c24096c/users/c4848deaa1474344adf0908d6ae629e3/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:16.651741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.654105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.654105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.684079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] MFA Rules not processed for user `c4848deaa1474344adf0908d6ae629e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:16.685326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:16.756100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 951/1905] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:16.767609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.820930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 955/1906] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:16 2022] POST /identity/v3/projects => generated 393 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:16.822246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:16.828628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88086-77c8-414b-9148-d93c10de0efc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.878665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.879311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.879591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.879865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.887507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cd78-8d54-4f94-9b01-1b35303fe8ab admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:16.892673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:16.893365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:16.893646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:16.893922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:16.894545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.896554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.942415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:16.943906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:16.955165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 952/1907] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:17.011471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 956/1908] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:16 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:17.015917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.028068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc8a5-e81d-48c6-9017-f7ffc901d879 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.038282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.038282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.038282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.038282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.038608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.040988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e9c8-5cc3-42ad-96a9-2985d3b9a98e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.055374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 953/1909] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:17.060055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.070416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672992f3-c73d-4b71-b4dd-94320af6d360 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.078261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.078261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.078261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.078261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] PATH_INFO: `/v3/projects/4a2b5d9c40d7457c9f090b03a6350995/users/23eb09061a7e4da699e76b1d46b1d6c6/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.102806 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2b5d9c40d7457c9f090b03a6350995, user_id=23eb09061a7e4da699e76b1d46b1d6c6, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.107204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.129973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2b6ce-8969-4ac7-9c2c-fdde8eb4d2f9 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.135465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2b6ce-8969-4ac7-9c2c-fdde8eb4d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.135465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2b6ce-8969-4ac7-9c2c-fdde8eb4d2f9 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.135465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 954/1910] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:04:17.141027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.141393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.141747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.166105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:17.167411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:17.183153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 957/1911] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:17 2022] PUT /identity/v3/projects/4a2b5d9c40d7457c9f090b03a6350995/users/23eb09061a7e4da699e76b1d46b1d6c6/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:17.189990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.209458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:17.240600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 955/1912] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:17.258665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df9e8-3233-4ea2-a618-550ebc509d5c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.265050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.269524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.269524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.269524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.269524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.269524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.282751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 958/1913] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:17.284083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.295911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c303e-39fe-4f9e-a20d-ceb25ff1f383 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.301372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.302112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.302399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.302676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] PATH_INFO: `/v3/projects/4a2b5d9c40d7457c9f090b03a6350995/users/23eb09061a7e4da699e76b1d46b1d6c6/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.310469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2b5d9c40d7457c9f090b03a6350995, user_id=23eb09061a7e4da699e76b1d46b1d6c6, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.310469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8d3ce-f529-4519-b3ae-94de7cecd43b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.327162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.330887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 956/1914] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:17 2022] PUT /identity/v3/projects/4a2b5d9c40d7457c9f090b03a6350995/users/23eb09061a7e4da699e76b1d46b1d6c6/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:17.334372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.334750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.335277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.365037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] MFA Rules not processed for user `23eb09061a7e4da699e76b1d46b1d6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:17.366247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:17.407270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6e77-4ddc-4496-91b4-81f9b9386ff1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.448163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 957/1915] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:17.449128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.452842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:17.462554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.463262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.463683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.463959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.522771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.524241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.528999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c940-eca6-4cce-912c-43bf839ae795 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.546992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 959/1916] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:17.547364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.547364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.547364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.547364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.552025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.554335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.570944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 958/1917] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:17.662398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:17.674105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7d82d-369a-4dd9-97ed-deb9256a1696 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:17.679017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:17.679647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:17.680226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:17.680554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:17.693851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:17.695611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:17.707883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 960/1918] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:18.624561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:18.635315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92ad9a-e88a-4672-87a7-ca5befcf4714 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:18.640113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:18.640951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:18.641444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:18.641776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:18.703934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:18.705483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fd41e-4335-4c07-99bc-70e962ee22b6 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:18.715913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 959/1919] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:19.117996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:19.120551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:19.192464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99897-2619-4f90-85a6-a7898e65ccda service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:19.197221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:19.197853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:19.198168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:19.198475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] PATH_INFO: `/v3/users/8dac234de37b49938c60249a9417a190` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:19.200096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dac234de37b49938c60249a9417a190)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:19.202151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:19.412269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dac234de37b49938c60249a9417a190'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:19.423404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dac234de37b49938c60249a9417a190'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:19.525888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dac234de37b49938c60249a9417a190'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:19.526602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dac234de37b49938c60249a9417a190'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:19.541483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dac234de37b49938c60249a9417a190'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:19.548081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 961/1920] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:19 2022] DELETE /identity/v3/users/8dac234de37b49938c60249a9417a190 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:19.552762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:19.553050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:19.553331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:19.573208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:19.574414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:19.628458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:19.632294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 960/1921] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:19.648542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:19.656766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:19.751287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debabeb6-ff81-43fa-8c35-840d5d4d97b2 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:19.761106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:19.763118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:19.763709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:19.764199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:19.774242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:19.776006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cbd6-0441-4f51-9c21-b94bab36f15f service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:19.788473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 962/1922] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:19.848735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:19.856136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:19.878563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e53342-0743-4921-b62f-6839c3709eaf None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:19.895535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:19.895535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:19.895535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:19.895535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] PATH_INFO: `/v3/users/78c6da83f38c496b841a79c5101b36c0` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:19.895902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c6da83f38c496b841a79c5101b36c0)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:19.895902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:20.312535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c6da83f38c496b841a79c5101b36c0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.319956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c6da83f38c496b841a79c5101b36c0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.433728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c6da83f38c496b841a79c5101b36c0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.448002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c6da83f38c496b841a79c5101b36c0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.448799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c6da83f38c496b841a79c5101b36c0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.455206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 961/1923] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:19 2022] DELETE /identity/v3/users/78c6da83f38c496b841a79c5101b36c0 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:20.459827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:20.460325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:20.460540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:20.490203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:20.490203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:20.518673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:20.518673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:20.584758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 963/1924] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:20.596257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:20.598286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:20.609200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff626-a84b-4d06-8467-4c11ae09db59 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:20.614067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:20.614898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:20.615180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:20.615451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] PATH_INFO: `/v3/projects/63eab457b88243d488deebd79b5836bd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:20.616595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63eab457b88243d488deebd79b5836bd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:20.618767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:20.693552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c4756-d1ec-406c-834a-64782b1ff793 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:20.701636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:20.702330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:20.704299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:20.704677 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:20.717288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:20.718818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:20.731191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:20.735504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 964/1925] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:20.793786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63eab457b88243d488deebd79b5836bd', 'request_id': 'req-1f53f67a-271b-4ed9-bbe2-1537210a4641'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.800247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63eab457b88243d488deebd79b5836bd', 'request_id': 'req-1f53f67a-271b-4ed9-bbe2-1537210a4641'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.802084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:20.804641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:20.824500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c97eb-35c0-4b54-a298-2cc67e7428be service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:20.870518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63eab457b88243d488deebd79b5836bd', 'request_id': 'req-1f53f67a-271b-4ed9-bbe2-1537210a4641'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.892369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:20.893362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:20.894078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:20.895222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] PATH_INFO: `/v3/users/d0451e6698644697b874d52592394b54` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:20.896701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0451e6698644697b874d52592394b54)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:20.899122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:20.904749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] The token cache is being invalidate because project 63eab457b88243d488deebd79b5836bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:20.911284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.911284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:20.911284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 962/1926] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:20 2022] DELETE /identity/v3/projects/63eab457b88243d488deebd79b5836bd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:20.912872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:20.914642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:20.931907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f67a-271b-4ed9-bbe2-1537210a4641 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:20.937932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:20.938619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:20.938934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:20.939207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] PATH_INFO: `/v3/users/9cbe5cb5170246cdb663b47dc13d1598` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:20.940408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbe5cb5170246cdb663b47dc13d1598)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:20.942593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:21.145221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0451e6698644697b874d52592394b54'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.152421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0451e6698644697b874d52592394b54'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.247106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0451e6698644697b874d52592394b54'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.248355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0451e6698644697b874d52592394b54'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.263610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d92154d2-7f4a-4526-b104-c7340f61d1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0451e6698644697b874d52592394b54'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.272927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 965/1927] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:20 2022] DELETE /identity/v3/users/d0451e6698644697b874d52592394b54 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:21.278803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:21.278803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:21.278803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:21.283867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbe5cb5170246cdb663b47dc13d1598'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.295713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbe5cb5170246cdb663b47dc13d1598'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.302315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:21.303675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:21.402064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbe5cb5170246cdb663b47dc13d1598'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.407597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 966/1928] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:21.407597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:21.411086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:21.424597 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbe5cb5170246cdb663b47dc13d1598'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.427888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbe5cb5170246cdb663b47dc13d1598'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.439817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857b99-c064-4824-bdc2-00737edbc541 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:21.442762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:21.444365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:21.444979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:21.445488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] PATH_INFO: `/v3/projects/c68236a30ca34d7fbaa2fdfe1d649c6c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:21.448979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68236a30ca34d7fbaa2fdfe1d649c6c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:21.451503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:21.452425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 963/1929] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:20 2022] DELETE /identity/v3/users/9cbe5cb5170246cdb663b47dc13d1598 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:21.453648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:21.455547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:21.526972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208695cc-23f7-4ce6-8671-77d63301d05b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:21.529646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:21.530264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:21.530546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:21.530851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:21.532634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:21.628291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:21.632516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:21.637079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68236a30ca34d7fbaa2fdfe1d649c6c', 'request_id': 'req-1fb65377-8114-400d-afe2-f317bedc8758'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.645829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68236a30ca34d7fbaa2fdfe1d649c6c', 'request_id': 'req-1fb65377-8114-400d-afe2-f317bedc8758'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.653667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 964/1930] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:21.653808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68236a30ca34d7fbaa2fdfe1d649c6c', 'request_id': 'req-1fb65377-8114-400d-afe2-f317bedc8758'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.775318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] The token cache is being invalidate because project c68236a30ca34d7fbaa2fdfe1d649c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:21.776146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.779738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:21.781635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 967/1931] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:21 2022] DELETE /identity/v3/projects/c68236a30ca34d7fbaa2fdfe1d649c6c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:21.786077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:21.788090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:21.815421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0404843-b50b-4c79-be3f-9db085eadf6a service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:21.964554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:21.965231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:21.965567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:21.965848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] PATH_INFO: `/v3/users/5a3200aacaec4fd18ad240c0ce097542` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:21.968053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3200aacaec4fd18ad240c0ce097542)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:21.971040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.134980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.134980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:22.148796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65377-8114-400d-afe2-f317bedc8758 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:22.154975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:22.155629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.155906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.156165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] PATH_INFO: `/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.157500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cbd67ca65144cd9ff3ca6e160ca429)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:22.159693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.307769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3200aacaec4fd18ad240c0ce097542'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.315153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3200aacaec4fd18ad240c0ce097542'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.393718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cbd67ca65144cd9ff3ca6e160ca429', 'request_id': 'req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.407355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cbd67ca65144cd9ff3ca6e160ca429', 'request_id': 'req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.415558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cbd67ca65144cd9ff3ca6e160ca429', 'request_id': 'req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.434265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3200aacaec4fd18ad240c0ce097542'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.456806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3200aacaec4fd18ad240c0ce097542'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.457683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3200aacaec4fd18ad240c0ce097542'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.464665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 965/1932] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:21 2022] DELETE /identity/v3/users/5a3200aacaec4fd18ad240c0ce097542 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:22.465530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.466996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:22.536478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] The token cache is being invalidate because project b0cbd67ca65144cd9ff3ca6e160ca429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:22.536886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.537522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d738da4b-5354-4a4b-b0b5-dc1dbb7f22bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.539839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 968/1933] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:22 2022] DELETE /identity/v3/projects/b0cbd67ca65144cd9ff3ca6e160ca429 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:22.542674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e237-0497-4d8a-86f3-4e3839e7cf6b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:22.546047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db29fa-db9f-4cfd-9a13-98e96d77a28c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.547118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db29fa-db9f-4cfd-9a13-98e96d77a28c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.547976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:22.548369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db29fa-db9f-4cfd-9a13-98e96d77a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.548621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.548900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.549172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] PATH_INFO: `/v3/projects/7d2b530a389a4c4e98b24c182b0a764e` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.550322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2b530a389a4c4e98b24c182b0a764e)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:22.552448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.578533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-23db29fa-db9f-4cfd-9a13-98e96d77a28c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:22.580759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-23db29fa-db9f-4cfd-9a13-98e96d77a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:22.589560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 969/1934] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:22.597559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.602389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.602389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.617431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:22.619243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:22.627099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 970/1935] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:22.634507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.643877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa288bc-09c1-45b7-9cc7-c30686d50979 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:22.648681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:22.649310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.649593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.649919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.650751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:22.651065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:22.652704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.664752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 971/1936] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:22.669068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.683074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897576-3555-4821-ade6-40a2daa24a44 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:22.693943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2b530a389a4c4e98b24c182b0a764e', 'request_id': 'req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.704320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2b530a389a4c4e98b24c182b0a764e', 'request_id': 'req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.766400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:22.767628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.768110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.768920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.769703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:22.771952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.783698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2b530a389a4c4e98b24c182b0a764e', 'request_id': 'req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.802771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] The token cache is being invalidate because project 7d2b530a389a4c4e98b24c182b0a764e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:22.803398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.807647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:22.811247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 966/1937] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:22 2022] DELETE /identity/v3/projects/7d2b530a389a4c4e98b24c182b0a764e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:22.815252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.818611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:22.837740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb37d1-f2c4-46a7-ae43-e02bf2e0bbe5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:22.843473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:22.844116 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:22.847295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:22.847295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] PATH_INFO: `/v3/users/672772782af04965b26f93a59505b3fe` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:22.851191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=672772782af04965b26f93a59505b3fe)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:22.867235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:22.906781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 972/1938] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:22 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:22.914358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:22.916682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.066583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae88b-e70f-4779-949c-a5dd6c86d62b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.076759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.076759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.076759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.076759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.077196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.077993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.155518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672772782af04965b26f93a59505b3fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.179451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672772782af04965b26f93a59505b3fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.202714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 973/1939] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:22 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:23.203932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.206020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.222637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec744-f969-46cf-8af2-6dc3b4e4cc71 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.232154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.233720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.233720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.234248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] PATH_INFO: `/v3/projects/20594c55b640478b9261269520718ce9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.235622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20594c55b640478b9261269520718ce9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.237718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.256713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:23.267816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672772782af04965b26f93a59505b3fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.285705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672772782af04965b26f93a59505b3fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.286649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672772782af04965b26f93a59505b3fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.308454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 967/1940] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:22 2022] DELETE /identity/v3/users/672772782af04965b26f93a59505b3fe => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:23.309556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.312987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.380038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20594c55b640478b9261269520718ce9', 'request_id': 'req-a1c9f945-4aea-41e9-82e0-99548da0ef0a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.389565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20594c55b640478b9261269520718ce9', 'request_id': 'req-a1c9f945-4aea-41e9-82e0-99548da0ef0a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.410684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20594c55b640478b9261269520718ce9', 'request_id': 'req-a1c9f945-4aea-41e9-82e0-99548da0ef0a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.445558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2578b-b6c8-4d05-b0c4-7eb4fce99d4b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.518877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] The token cache is being invalidate because project 20594c55b640478b9261269520718ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:23.519448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.523323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1c9f945-4aea-41e9-82e0-99548da0ef0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:23.523871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.524893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.525178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 974/1941] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:23 2022] DELETE /identity/v3/projects/20594c55b640478b9261269520718ce9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:23.525746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.526291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.527266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.529388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.530057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667020b-ef9a-47f8-8137-88181e762f6f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.530558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667020b-ef9a-47f8-8137-88181e762f6f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.531019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667020b-ef9a-47f8-8137-88181e762f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.559977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 968/1942] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:23.569080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.571826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.590564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0667020b-ef9a-47f8-8137-88181e762f6f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:23.592117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0667020b-ef9a-47f8-8137-88181e762f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.601363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e538-a2b3-4a0c-9adc-30a2ee35b2eb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.611411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 975/1943] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:23.611624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.611624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.611624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.611624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.612149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.613769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.614699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.615204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.615578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.647464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 969/1944] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:23.651428 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.657505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:23.658820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.676887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 976/1945] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:23.678505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.687314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c7398-102f-47f6-a469-c188856883f9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.693898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.694049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe064-859a-4733-9dbb-688da5e860ab None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.695029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.695366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.695695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] PATH_INFO: `/v3/projects/74887493d79f409290b7433c92f2d9a2/users/840fb4e4d3b8420791a84a0aaf2127ab/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.701310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.702237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.702621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.703040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.703787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:23.704168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.705858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.713332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74887493d79f409290b7433c92f2d9a2, user_id=840fb4e4d3b8420791a84a0aaf2127ab, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.716267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92caa-451c-4369-94e0-dcef8081bc7c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.718759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 977/1946] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:23.722924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.733191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677496c-fcc6-4feb-a4da-394d6bebe7c2 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.737786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.738362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.738642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.739078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.739700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.741587 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:23.858624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 970/1947] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:23 2022] PUT /identity/v3/projects/74887493d79f409290b7433c92f2d9a2/users/840fb4e4d3b8420791a84a0aaf2127ab/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:23.864514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.864809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.865107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.894204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:23.894913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 978/1948] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:23 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:23.897785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.901636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.981538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 971/1949] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:23.985925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641fd8-bd10-4633-9482-f901a4a97ae7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:23.990815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:23.991422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:23.991704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:23.992019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:23.992133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:23.992755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:23.994175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:23.995158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.056063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a61dd-064b-4596-85df-91d2ab34758b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.059799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.060529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.067609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.067609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.073471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.073471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.087599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 972/1950] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:24.088710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.091231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:24.103664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:24.109727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e6ab0-3bc7-4d48-848f-c7746bd0f7b6 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.114116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 979/1951] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:23 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:24.117289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.120584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.121535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.121871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.122145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] PATH_INFO: `/v3/projects/2360d56b165540298679146115c027e7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.144369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2360d56b165540298679146115c027e7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.144369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.144664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7d2b-1b72-4638-9815-1f791d630562 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.151676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.152581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.152869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.153145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.153802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.155458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.170761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 980/1952] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:24.172127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.182947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e656-934e-4aec-b0b5-3634011c708c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.187929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.188518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.188796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.189071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.190370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.191326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.204631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 981/1953] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:24.216915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.244150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b9dd0-dfc4-4225-a7d0-80c807d4de3b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.268081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2360d56b165540298679146115c027e7', 'request_id': 'req-4147f7b7-703d-413f-ab95-926e535ad235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:24.279731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2360d56b165540298679146115c027e7', 'request_id': 'req-4147f7b7-703d-413f-ab95-926e535ad235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:24.315650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.316317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.316599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.316876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] PATH_INFO: `/v3/projects/278a6a49dd9a4b25943e77ed014b72d9/users/bd62929c9d9d432880258b198d2d67c8/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.332981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278a6a49dd9a4b25943e77ed014b72d9, user_id=bd62929c9d9d432880258b198d2d67c8, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.335896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9208f7-55e5-43ee-9cdd-2322018a7c82 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.353781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2360d56b165540298679146115c027e7', 'request_id': 'req-4147f7b7-703d-413f-ab95-926e535ad235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:24.368398 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] The token cache is being invalidate because project 2360d56b165540298679146115c027e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:24.368847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:24.369970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4147f7b7-703d-413f-ab95-926e535ad235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:24.372585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 973/1954] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:24 2022] DELETE /identity/v3/projects/2360d56b165540298679146115c027e7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:24.377477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704696f8-b780-4b16-b985-d5e34a5a8091 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.377759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704696f8-b780-4b16-b985-d5e34a5a8091 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.378032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704696f8-b780-4b16-b985-d5e34a5a8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.403907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-704696f8-b780-4b16-b985-d5e34a5a8091 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:24.405051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-704696f8-b780-4b16-b985-d5e34a5a8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:24.414400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 974/1955] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:24.422785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.423289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.423810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.445067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:24.447650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:24.456352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 975/1956] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:24.461289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.473991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335cb2d-47be-4653-ac87-aa6769285e2f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.503171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 982/1957] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:24 2022] PUT /identity/v3/projects/278a6a49dd9a4b25943e77ed014b72d9/users/bd62929c9d9d432880258b198d2d67c8/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:24.520876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.521164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.522041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.562333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] MFA Rules not processed for user `bd62929c9d9d432880258b198d2d67c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:24.564422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:24.593535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.594281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.594585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.594906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.596671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:24.597253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.598995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.616658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 976/1958] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:24.619623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.638974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392825-4c85-46bb-8ea3-1ac6667f6b86 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.645199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.645981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.646111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.646340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.647027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.650984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.669391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 983/1959] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:24.670580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.675570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:24.702057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c2aa7-e4d3-4f2c-92cd-640d5c123b58 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.712520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.712520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.712520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.712520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.713174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.713174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.809213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 977/1960] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:24.813892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.858295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 984/1961] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:24.863690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:24.900651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eae5a-c63c-43da-9f42-c598bb6c61de admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.959471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062517-fc0e-4b2e-841b-30e897f4f51a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:24.963060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.964386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.964624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:24.964734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.964936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.965236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:24.965548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:24.965641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.965856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:24.966510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:24.967502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:24.968504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.083942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 985/1962] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:25.083942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.086337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.099527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411140-973d-45c9-96f2-1d4f6b571199 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.109334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.109854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.111524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.111973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] PATH_INFO: `/v3/users/dac6a2a472294832b1dcb6e2487ed39d` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.113363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 978/1963] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:24 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:25.113688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac6a2a472294832b1dcb6e2487ed39d)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.114575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.116405 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.129958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdcdb-7aa6-4722-985a-868664e6c9e8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.140178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.141354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.141986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.142640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.143570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.145320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.161523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 979/1964] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:25.162746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.175004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032068-96ca-4d89-b9bb-2e4c296cf218 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.181814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.184420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.184718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.185052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.185790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.187731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.199145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 980/1965] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:25.200536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.211509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f023e-cd5f-42b5-804a-5fa75ce8e6c3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.216196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.216870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.217149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.217421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] PATH_INFO: `/v3/projects/04b8572337af4a9b8dfe843a3a5218e8/users/a6ddf6d3fce74d499c6adac8b1585c67/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.232604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b8572337af4a9b8dfe843a3a5218e8, user_id=a6ddf6d3fce74d499c6adac8b1585c67, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.237519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.400716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 981/1966] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:25 2022] PUT /identity/v3/projects/04b8572337af4a9b8dfe843a3a5218e8/users/a6ddf6d3fce74d499c6adac8b1585c67/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:25.404608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.410196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac6a2a472294832b1dcb6e2487ed39d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:25.417674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac6a2a472294832b1dcb6e2487ed39d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:25.468075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207a16-4dd7-4f8f-8655-e2feaa2f686a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.473217 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.473860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.474140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.474411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.475494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.477188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.488023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 982/1967] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:25.488847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.500891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd9fe-0b4a-403c-8017-dba14e726fd8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.506201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.506891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.507176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.507452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.508102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.509950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.524644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 983/1968] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:25.524644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.531914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f4c1-3a20-4c3a-b9c7-b24215940289 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.536553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.537198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.537479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.537752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] PATH_INFO: `/v3/projects/de7fd3e8151541feae3dc63075601f1d/users/3ef64015a89943a787c1a5f40b39d1db/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.547639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac6a2a472294832b1dcb6e2487ed39d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:25.548247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac6a2a472294832b1dcb6e2487ed39d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:25.556206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7fd3e8151541feae3dc63075601f1d, user_id=3ef64015a89943a787c1a5f40b39d1db, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.558904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e786a-bd52-49bc-a9a9-5bae0d968d50 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.561864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac6a2a472294832b1dcb6e2487ed39d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:25.568017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 986/1969] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:25 2022] DELETE /identity/v3/users/dac6a2a472294832b1dcb6e2487ed39d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:25.568802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.570113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.643166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3878e-6b01-41f6-a2db-6e2acd897302 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.648294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.656080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.656080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.656080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] PATH_INFO: `/v3/projects/04b8572337af4a9b8dfe843a3a5218e8/users/a6ddf6d3fce74d499c6adac8b1585c67/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.656080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b8572337af4a9b8dfe843a3a5218e8, user_id=a6ddf6d3fce74d499c6adac8b1585c67, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.656080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e510e-9e54-4bda-905a-e5a130451392 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.666197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 987/1970] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:25 2022] PUT /identity/v3/projects/04b8572337af4a9b8dfe843a3a5218e8/users/a6ddf6d3fce74d499c6adac8b1585c67/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:25.667432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8fbf-1817-4629-9ab9-4b5931295657 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.667767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8fbf-1817-4629-9ab9-4b5931295657 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.667986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8fbf-1817-4629-9ab9-4b5931295657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.689653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bb7f8fbf-1817-4629-9ab9-4b5931295657 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:25.690948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bb7f8fbf-1817-4629-9ab9-4b5931295657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.693307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 984/1971] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:25 2022] PUT /identity/v3/projects/de7fd3e8151541feae3dc63075601f1d/users/3ef64015a89943a787c1a5f40b39d1db/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:25.706040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.711715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.711715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.738071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] MFA Rules not processed for user `a6ddf6d3fce74d499c6adac8b1585c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:25.739446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.782397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 988/1972] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:25.786257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36948-884a-4723-88f1-42f2a9948cda None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.786257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36948-884a-4723-88f1-42f2a9948cda None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.786257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36948-884a-4723-88f1-42f2a9948cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.821843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-36c36948-884a-4723-88f1-42f2a9948cda None None] MFA Rules not processed for user `3ef64015a89943a787c1a5f40b39d1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:25.822556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-36c36948-884a-4723-88f1-42f2a9948cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.826769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 985/1973] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:25.827473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.829185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:25.897448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323ff76-b936-46ca-99e1-6b1d828a7166 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:25.903524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:25.906890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.906890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.906890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.916067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:25.917535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:25.928813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 989/1974] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:25.929232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 986/1975] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:25.929360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:25.929742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:25.929899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:25.930193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:25.931789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.013344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] MFA Rules not processed for user `840fb4e4d3b8420791a84a0aaf2127ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:26.014749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.017935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9d904-6d94-4f4a-81bd-b677e0b6b9fd service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.024013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.026614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.028239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.028239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.043688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.045320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.068271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 987/1976] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:26.070108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.073305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.094478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08718d0-1fd7-4783-8aad-3ff1776f014b service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.101875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.102534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.103082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.103363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.104641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.108302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.112645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:26.132323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 990/1977] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:26.132323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.133542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.156857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b20f3c-25ba-4fda-a059-967b66872e70 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.163910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.164527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.164998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.170688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.170688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.170688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.190597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:26.257572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 988/1978] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:26 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:26.262269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.304839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 991/1979] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:26 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:26.307483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.342871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893fb7-578b-4267-bed4-a9da8ab3c0a9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.427320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f184d2-da56-4ce1-8821-da9793dc4a77 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.439845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.440627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.441004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.441356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.442279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.442705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.443861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.444165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.444431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.444780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.445066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.448333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.546052 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 992/1980] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:26 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:26.546271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 989/1981] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:26 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:26.547700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.554191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.560536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea84d-556f-470d-9841-362175280c65 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.566061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.566215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa6bc-17e8-4c3b-961a-d57a94854034 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.566672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.566983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.567256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.567892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.569587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.571783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.572155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.572666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.572797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.573644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.576627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.580792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 990/1982] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:26.585031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.595374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 993/1983] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:26.596111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916816-c2ae-425d-b7fa-800ab9ff71b8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.601093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.601924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.602748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.603095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] PATH_INFO: `/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e/users/aaf3a795cd124727a93424fd07358ccd/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.606897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.608505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.619107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6079926d9b4d19a4d22f4bb5f6690e, user_id=aaf3a795cd124727a93424fd07358ccd, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.621892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.625831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326f83-c598-46e5-bd91-41891a605ef0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.631198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.631854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.632134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.632441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] PATH_INFO: `/v3/projects/53ed0ed0fc2e49efa76375bd4cf0c7de` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.633702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ed0ed0fc2e49efa76375bd4cf0c7de)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.635899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.754303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 991/1984] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:26 2022] PUT /identity/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e/users/aaf3a795cd124727a93424fd07358ccd/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:26.755136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.774926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ed0ed0fc2e49efa76375bd4cf0c7de', 'request_id': 'req-af9e5519-2a8d-4389-9b85-d24e76078f2c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:26.783241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ed0ed0fc2e49efa76375bd4cf0c7de', 'request_id': 'req-af9e5519-2a8d-4389-9b85-d24e76078f2c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:26.789269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ed0ed0fc2e49efa76375bd4cf0c7de', 'request_id': 'req-af9e5519-2a8d-4389-9b85-d24e76078f2c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:26.831410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13a66-d747-49fa-ae2a-e90f01798a29 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.886084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] The token cache is being invalidate because project 53ed0ed0fc2e49efa76375bd4cf0c7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:26.886481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:26.887058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:26.888721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 994/1985] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:26 2022] DELETE /identity/v3/projects/53ed0ed0fc2e49efa76375bd4cf0c7de => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:26.889486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.890822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.901343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.902025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.902306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.902632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] PATH_INFO: `/v3/projects/aeb7ce0969d04132b4d2aec0025746ae/users/f3aa12fe52784078994d7da09fd5fb50/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.914899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e5519-2a8d-4389-9b85-d24e76078f2c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.920396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb7ce0969d04132b4d2aec0025746ae, user_id=f3aa12fe52784078994d7da09fd5fb50, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.920939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.920939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.921411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.921523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.922122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.923500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.930964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:26.934928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 995/1986] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:26.938863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:26.940580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:26.954331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7849-f939-4bdc-929c-ccaa4ad5c755 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:26.959705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:26.960417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:26.960773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:26.961120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] PATH_INFO: `/v3/users/23eb09061a7e4da699e76b1d46b1d6c6` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:26.962520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23eb09061a7e4da699e76b1d46b1d6c6)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:26.964715 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.051207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 992/1987] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:26 2022] PUT /identity/v3/projects/aeb7ce0969d04132b4d2aec0025746ae/users/f3aa12fe52784078994d7da09fd5fb50/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:27.052063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.112741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b595-b6b9-46f2-9859-d487e4567391 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.117484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.118652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.118963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.119232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] PATH_INFO: `/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e/users/aaf3a795cd124727a93424fd07358ccd/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.121141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6079926d9b4d19a4d22f4bb5f6690e, user_id=aaf3a795cd124727a93424fd07358ccd, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.123867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.134370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 993/1988] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:27 2022] PUT /identity/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e/users/aaf3a795cd124727a93424fd07358ccd/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:27.135252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.136801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.144264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:27.187723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23eb09061a7e4da699e76b1d46b1d6c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.195228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23eb09061a7e4da699e76b1d46b1d6c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.233181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2cee-1490-4587-83f4-d7079c1a8af8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.240481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.240481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.240816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.241155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.241882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.244609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.258524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 994/1989] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:27.259882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.268941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23eb09061a7e4da699e76b1d46b1d6c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.271768 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23eb09061a7e4da699e76b1d46b1d6c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.277440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6dd7-e1f2-47f9-ac31-1bfc5e7cdc99 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.284138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.287429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.287954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.288177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] PATH_INFO: `/v3/projects/aeb7ce0969d04132b4d2aec0025746ae/users/f3aa12fe52784078994d7da09fd5fb50/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.291728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb7ce0969d04132b4d2aec0025746ae, user_id=f3aa12fe52784078994d7da09fd5fb50, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.295078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b5d9-7697-4f54-b42d-8a87a51ed073 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.302288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23eb09061a7e4da699e76b1d46b1d6c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.322054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 995/1990] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:27 2022] PUT /identity/v3/projects/aeb7ce0969d04132b4d2aec0025746ae/users/f3aa12fe52784078994d7da09fd5fb50/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:27.322151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 996/1991] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:26 2022] DELETE /identity/v3/users/23eb09061a7e4da699e76b1d46b1d6c6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:27.329046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.329403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.329745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.370076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] MFA Rules not processed for user `f3aa12fe52784078994d7da09fd5fb50`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:27.371763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.453977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.455953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.471871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 996/1992] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:27.513680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.526430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.533866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192af9-7377-4406-9def-8ecb107e3a08 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.538782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ddf6d3fce74d499c6adac8b1585c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b8572337af4a9b8dfe843a3a5218e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.539480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.539913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.540662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.547545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:27.548991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.552039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.576286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 997/1993] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:04:27.577807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.580988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.627762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed339-be21-4ff3-9bca-5f5150959b7e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.637946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.638977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.638977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.644066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] PATH_INFO: `/v3/users/d32fa1efe367426f8d5af3508d3117a6` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.644066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32fa1efe367426f8d5af3508d3117a6)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.644552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.673308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c239a4-a2d1-4014-ac74-f50e77234b93 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.681941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.682574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.684617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.684909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.700390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.702097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.718374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 998/1994] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:27.719392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:27.721945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:27.739410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdb7b8-83e9-43e3-9b19-56b3dd30e11d service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:27.744910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:27.745664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:27.745908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:27.746185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] PATH_INFO: `/v3/users/db3aa0724b0744a5850ffdd054abeca4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:27.747354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3aa0724b0744a5850ffdd054abeca4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:27.749436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:27.945690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32fa1efe367426f8d5af3508d3117a6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:27.954219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32fa1efe367426f8d5af3508d3117a6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.031224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3aa0724b0744a5850ffdd054abeca4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.038186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3aa0724b0744a5850ffdd054abeca4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.045049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32fa1efe367426f8d5af3508d3117a6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.048760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:28.069989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32fa1efe367426f8d5af3508d3117a6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.070752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32fa1efe367426f8d5af3508d3117a6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.078199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 997/1995] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:27 2022] DELETE /identity/v3/users/d32fa1efe367426f8d5af3508d3117a6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:28.086024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.086024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.112924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3aa0724b0744a5850ffdd054abeca4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.113549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3aa0724b0744a5850ffdd054abeca4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.127424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3aa0724b0744a5850ffdd054abeca4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.135263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 999/1996] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:27 2022] DELETE /identity/v3/users/db3aa0724b0744a5850ffdd054abeca4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:28.136386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.142080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:28.142080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.159807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51493025-ee7a-473d-a2c0-6627b68b130f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.219619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba945c2-62cf-4a55-ba11-1bdec718e12a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.222488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ddf6d3fce74d499c6adac8b1585c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b8572337af4a9b8dfe843a3a5218e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.223409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.223683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.223920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.224458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.224680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.225057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.225334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.225692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] PATH_INFO: `/v3/users/3ef64015a89943a787c1a5f40b39d1db` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.227824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef64015a89943a787c1a5f40b39d1db)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.229819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.233521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.321127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 998/1997] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/projects => generated 353 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:28.322064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.325374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.387574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94abee-ddb1-4a88-aa54-8d923733ba8f tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.392117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.392786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.393015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.393280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] PATH_INFO: `/v3/projects/4a2b5d9c40d7457c9f090b03a6350995` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.394400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2b5d9c40d7457c9f090b03a6350995)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.396327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.413282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef64015a89943a787c1a5f40b39d1db'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.424474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef64015a89943a787c1a5f40b39d1db'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.530713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef64015a89943a787c1a5f40b39d1db'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.533342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef64015a89943a787c1a5f40b39d1db'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.546867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7b998d1e-7822-4267-9d20-0d5aea824870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef64015a89943a787c1a5f40b39d1db'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.553694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1000/1998] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:28 2022] DELETE /identity/v3/users/3ef64015a89943a787c1a5f40b39d1db => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:28.554971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049327b-5d2c-45d3-a78f-f2c813195bfc None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.555820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049327b-5d2c-45d3-a78f-f2c813195bfc None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.556348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049327b-5d2c-45d3-a78f-f2c813195bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.561457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2b5d9c40d7457c9f090b03a6350995', 'request_id': 'req-42937240-c53b-4902-97f7-b33bf43a678e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.568497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2b5d9c40d7457c9f090b03a6350995', 'request_id': 'req-42937240-c53b-4902-97f7-b33bf43a678e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.577323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f049327b-5d2c-45d3-a78f-f2c813195bfc None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:28.578692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f049327b-5d2c-45d3-a78f-f2c813195bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.645959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1001/1999] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:28.647254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.647541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.647836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.667310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:28.668522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.676313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1002/2000] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:28.677299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.678866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.680770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2b5d9c40d7457c9f090b03a6350995', 'request_id': 'req-42937240-c53b-4902-97f7-b33bf43a678e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.697047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] The token cache is being invalidate because project 4a2b5d9c40d7457c9f090b03a6350995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:28.697344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.698162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-42937240-c53b-4902-97f7-b33bf43a678e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:28.700146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 999/2001] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:28 2022] DELETE /identity/v3/projects/4a2b5d9c40d7457c9f090b03a6350995 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:28.701878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.702956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.703402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.740219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:28.741442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.750214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1000/2002] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:28.751288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.755497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.762370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c62f-3eec-4354-b690-053abf94fedf None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.768505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ddf6d3fce74d499c6adac8b1585c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b8572337af4a9b8dfe843a3a5218e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.769354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.769750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.780719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.780719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:28.780719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.780719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.788926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1003/2003] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:28.788926 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.792257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.826909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ae37-2dbf-4281-a179-ebaa8048201b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.831861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.832410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.832684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.832951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.834714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.850888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.853030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e717cb-0923-48f3-8c8f-d6cfc86174f4 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.869630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329d18-5d29-4dce-9407-b0a0d3bd1899 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.872718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1001/2004] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:28.874219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.875023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.875374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.875723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.876714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.877463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.878090 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.878435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.893109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.894408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.901839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:28.903674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.907072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1004/2005] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:28.908070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.909603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.922969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1002/2006] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:28.922969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:28.922969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:28.937774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ffeac-59b9-4a8d-be9f-c4cffa22e75f service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.938914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f7c3-3198-4966-a0e6-88c80c43d949 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:28.941327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.942172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.942663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.942813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.947019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ddf6d3fce74d499c6adac8b1585c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b8572337af4a9b8dfe843a3a5218e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:28.947829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.948212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.948593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] PATH_INFO: `/v3/projects/3ec2bdbcc0bb4abfaf85b2259bbcc64c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:28.950284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ec2bdbcc0bb4abfaf85b2259bbcc64c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.952669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.965839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:28.967756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df678-dfc4-4950-afd8-689030a78424 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:28.985297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1005/2007] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:28.988334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4b6-ab9b-46db-89a7-e68be323b3f7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:28.988945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4b6-ab9b-46db-89a7-e68be323b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:28.989346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c4b6-ab9b-46db-89a7-e68be323b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.024896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8d15c4b6-ab9b-46db-89a7-e68be323b3f7 None None] MFA Rules not processed for user `aaf3a795cd124727a93424fd07358ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:29.025975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8d15c4b6-ab9b-46db-89a7-e68be323b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.107712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1006/2008] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:29.109121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c044f7-28ca-4ed0-ac87-a98325686692 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.109412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c044f7-28ca-4ed0-ac87-a98325686692 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.109686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c044f7-28ca-4ed0-ac87-a98325686692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.129426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-03c044f7-28ca-4ed0-ac87-a98325686692 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:29.130620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-03c044f7-28ca-4ed0-ac87-a98325686692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.139571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1007/2009] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:29.140731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.141015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.141298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.160208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] MFA Rules not processed for user `840fb4e4d3b8420791a84a0aaf2127ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:29.161421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.175078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec2bdbcc0bb4abfaf85b2259bbcc64c', 'request_id': 'req-755226bb-e2ac-4004-9bc9-79dac3495b60'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:29.181164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec2bdbcc0bb4abfaf85b2259bbcc64c', 'request_id': 'req-755226bb-e2ac-4004-9bc9-79dac3495b60'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:29.228735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1008/2010] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:29.228735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.273797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec2bdbcc0bb4abfaf85b2259bbcc64c', 'request_id': 'req-755226bb-e2ac-4004-9bc9-79dac3495b60'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:29.297102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] The token cache is being invalidate because project 3ec2bdbcc0bb4abfaf85b2259bbcc64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:29.297405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:29.298089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:29.299831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1003/2011] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:28 2022] DELETE /identity/v3/projects/3ec2bdbcc0bb4abfaf85b2259bbcc64c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:29.300836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.305216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.386018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f534-96cd-4f07-ad66-49bf4d2e270b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.394884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.400954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:29.425358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1009/2012] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:29.431230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.433382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.448316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1f98-0183-4c89-871f-d13327c75a54 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.453753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.454417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.454695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.455002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.455637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.457551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:29.495138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755226bb-e2ac-4004-9bc9-79dac3495b60 tempest-VolumeQuotaClassesTest-545566452 tempest-VolumeQuotaClassesTest-545566452-project-admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.501472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.502282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.502766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.503239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.505157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.516204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.517860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:29.527491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1004/2013] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:29.562705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1010/2014] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:29 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:29.562860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.571953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f98b22-435b-4cdc-83b1-1607fd3c12c5 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.632063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.632608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.632891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.633161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.633853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.635892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:29.657205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.662509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.697969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b30919-721a-4fbe-8ba1-b3d85bdc10c3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.705031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.705564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.707154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.707447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] PATH_INFO: `/v3/projects/61478a17a673434cad388ce84b80a49c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.708947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=61478a17a673434cad388ce84b80a49c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.714878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:29.723959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1005/2015] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:29 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:29.723959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:29.725009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:29.762896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd216-31e6-46b6-9a68-0511b488ccc9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:29.769833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:29.770623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:29.771702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:29.772131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] PATH_INFO: `/v3/projects/de7fd3e8151541feae3dc63075601f1d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:29.773429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7fd3e8151541feae3dc63075601f1d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:29.776636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:30.080848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61478a17a673434cad388ce84b80a49c', 'request_id': 'req-60c84fc4-5cd0-44ed-866a-e21d4654d25d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.088313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61478a17a673434cad388ce84b80a49c', 'request_id': 'req-60c84fc4-5cd0-44ed-866a-e21d4654d25d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.093960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61478a17a673434cad388ce84b80a49c', 'request_id': 'req-60c84fc4-5cd0-44ed-866a-e21d4654d25d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.134941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7fd3e8151541feae3dc63075601f1d', 'request_id': 'req-0c8f229a-cf68-45d4-9350-4105bab26387'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.140556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7fd3e8151541feae3dc63075601f1d', 'request_id': 'req-0c8f229a-cf68-45d4-9350-4105bab26387'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.215552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] The token cache is being invalidate because project 61478a17a673434cad388ce84b80a49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:30.216905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.216905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.217971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1011/2016] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:29 2022] DELETE /identity/v3/projects/61478a17a673434cad388ce84b80a49c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:30.221741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:30.221741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:30.290757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c84fc4-5cd0-44ed-866a-e21d4654d25d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:30.313146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7fd3e8151541feae3dc63075601f1d', 'request_id': 'req-0c8f229a-cf68-45d4-9350-4105bab26387'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.330233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] The token cache is being invalidate because project de7fd3e8151541feae3dc63075601f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:30.330527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.331216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.337242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1006/2017] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:29 2022] DELETE /identity/v3/projects/de7fd3e8151541feae3dc63075601f1d => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:30.338112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:30.344615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:30.381543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:30.382191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:30.382519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:30.382837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] PATH_INFO: `/v3/projects/e3d1fe1ff08949aabf55da335eeb066c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:30.391079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d1fe1ff08949aabf55da335eeb066c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:30.391079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:30.440223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f229a-cf68-45d4-9350-4105bab26387 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:30.445009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:30.445620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:30.446055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:30.446436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:30.447502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:30.449349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:30.467148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1007/2018] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:30.467148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:30.467148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:30.475990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013268-a0bb-4384-84c1-99f8346793d9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:30.482237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:30.483082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:30.483349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:30.483619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] PATH_INFO: `/v3/users/c4848deaa1474344adf0908d6ae629e3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:30.486853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4848deaa1474344adf0908d6ae629e3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:30.488763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:30.505531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d1fe1ff08949aabf55da335eeb066c', 'request_id': 'req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.513174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d1fe1ff08949aabf55da335eeb066c', 'request_id': 'req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.519088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d1fe1ff08949aabf55da335eeb066c', 'request_id': 'req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.578857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:30.632539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] The token cache is being invalidate because project e3d1fe1ff08949aabf55da335eeb066c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:30.632825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.633515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.635631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1012/2019] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:30 2022] DELETE /identity/v3/projects/e3d1fe1ff08949aabf55da335eeb066c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:30.635942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:30.637286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:30.646058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:30.661961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4848deaa1474344adf0908d6ae629e3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.669845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4848deaa1474344adf0908d6ae629e3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.712114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c5ea9-68f5-4e04-b68d-81da08f825b3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:30.717093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:30.717755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:30.718033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:30.718309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] PATH_INFO: `/v3/users/f3aa12fe52784078994d7da09fd5fb50` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:30.719488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3aa12fe52784078994d7da09fd5fb50)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:30.721425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:30.792956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4848deaa1474344adf0908d6ae629e3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.805821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4848deaa1474344adf0908d6ae629e3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.806479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4848deaa1474344adf0908d6ae629e3'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:30.812289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1008/2020] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:30 2022] DELETE /identity/v3/users/c4848deaa1474344adf0908d6ae629e3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:30.813061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:30.814381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:30.896417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43514-f177-4a98-8343-dcdbeeb58ac0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:30.901497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:30.902202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:30.902543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:30.902913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] PATH_INFO: `/v3/users/bd62929c9d9d432880258b198d2d67c8` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:30.904113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd62929c9d9d432880258b198d2d67c8)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:30.906144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:31.023198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3aa12fe52784078994d7da09fd5fb50'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.031486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3aa12fe52784078994d7da09fd5fb50'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.159606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3aa12fe52784078994d7da09fd5fb50'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.160358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3aa12fe52784078994d7da09fd5fb50'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.181625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3aa12fe52784078994d7da09fd5fb50'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.181875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd62929c9d9d432880258b198d2d67c8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.189548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd62929c9d9d432880258b198d2d67c8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.191123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1013/2021] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:30 2022] DELETE /identity/v3/users/f3aa12fe52784078994d7da09fd5fb50 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:31.192412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.200380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.273632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd62929c9d9d432880258b198d2d67c8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.282274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ca96-d3d7-45bc-96db-8f8717696dab admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:31.292991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd62929c9d9d432880258b198d2d67c8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.293788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:31.294629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.295536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd62929c9d9d432880258b198d2d67c8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.295854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.296296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.297208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:31.299822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:31.327254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1014/2022] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:31.327254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.327254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.333244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1009/2023] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:30 2022] DELETE /identity/v3/users/bd62929c9d9d432880258b198d2d67c8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:31.334041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.335497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.344508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afbf5-da74-47e5-9b45-6880da3520e1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:31.405820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:31.406458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.406757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.407034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] PATH_INFO: `/v3/users/a9a995b00ad44505b9b6c003dd2ed60c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.408183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a995b00ad44505b9b6c003dd2ed60c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:31.409414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d332a-9607-4b65-bdba-cbf66c3e9eb2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:31.410129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:31.414487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:31.415815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.416095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.416366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] PATH_INFO: `/v3/projects/8849efa09aa24ab28e63cc6eebda923f/users/f2637de2ce614673b19281880a7bc9c9/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.440441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8849efa09aa24ab28e63cc6eebda923f, user_id=f2637de2ce614673b19281880a7bc9c9, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:31.443157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc37c-7a5e-4b9f-8a16-5a61fc64abf8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:31.581378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1010/2024] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:31 2022] PUT /identity/v3/projects/8849efa09aa24ab28e63cc6eebda923f/users/f2637de2ce614673b19281880a7bc9c9/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:31.581378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.581378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.581378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.598934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:31.600139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.659055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a995b00ad44505b9b6c003dd2ed60c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.662178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1011/2025] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:31.663044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.664290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.668521 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a995b00ad44505b9b6c003dd2ed60c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.676762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9293-c74c-4cfe-a726-6390fbf97ad4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:31.681869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:31.682529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.682851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.683128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] PATH_INFO: `/v3/projects/449535adaee5416b8bffa9b50c24096c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.684255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=449535adaee5416b8bffa9b50c24096c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:31.686162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:31.746595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a995b00ad44505b9b6c003dd2ed60c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.747299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a995b00ad44505b9b6c003dd2ed60c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.760489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a1fb1be7-7953-4b0f-b2ee-b2804a1d2b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a995b00ad44505b9b6c003dd2ed60c'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.766761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1015/2026] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:31 2022] DELETE /identity/v3/users/a9a995b00ad44505b9b6c003dd2ed60c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:31.768057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.768515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.768824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.797810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] MFA Rules not processed for user `f2637de2ce614673b19281880a7bc9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:31.799063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.823959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449535adaee5416b8bffa9b50c24096c', 'request_id': 'req-37a9e411-b7ec-42c0-85fc-a6968db27e2e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.830169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449535adaee5416b8bffa9b50c24096c', 'request_id': 'req-37a9e411-b7ec-42c0-85fc-a6968db27e2e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.866283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1016/2027] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:31.867165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.868617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.923426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853ad4-10c8-49cf-806a-aa2fafdd173f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:31.958788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449535adaee5416b8bffa9b50c24096c', 'request_id': 'req-37a9e411-b7ec-42c0-85fc-a6968db27e2e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.971952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] The token cache is being invalidate because project 449535adaee5416b8bffa9b50c24096c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:31.972397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.973175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:31.974006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:31.974625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:31.974967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:31.975368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1012/2028] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:31 2022] DELETE /identity/v3/projects/449535adaee5416b8bffa9b50c24096c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:31.975487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:31.977388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:31.980894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:31.982404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.054430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e411-b7ec-42c0-85fc-a6968db27e2e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.056920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.058371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.060478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.061299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.061748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.062177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] PATH_INFO: `/v3/projects/aeb7ce0969d04132b4d2aec0025746ae` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.064536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb7ce0969d04132b4d2aec0025746ae)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.067271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.068694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1017/2029] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:32.069491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.073204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.089034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b97b-8a4f-47d8-97ba-d87c34a6ae6c service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.094494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.095367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.095690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.096060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.096771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.100174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b315d3f-85bf-4fbe-94be-b0237e1dadaf admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.170979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb7ce0969d04132b4d2aec0025746ae', 'request_id': 'req-cd7b8fef-574d-4e04-b1f3-40e948925af9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.176468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb7ce0969d04132b4d2aec0025746ae', 'request_id': 'req-cd7b8fef-574d-4e04-b1f3-40e948925af9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.194771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1018/2030] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:32.197509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.197939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.198229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.217941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.219202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.273355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb7ce0969d04132b4d2aec0025746ae', 'request_id': 'req-cd7b8fef-574d-4e04-b1f3-40e948925af9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.286350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] The token cache is being invalidate because project aeb7ce0969d04132b4d2aec0025746ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:32.286920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.287981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.295030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1019/2031] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:32.295550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1013/2032] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:31 2022] DELETE /identity/v3/projects/aeb7ce0969d04132b4d2aec0025746ae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:32.295735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.295827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.297029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.313396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85417052-ac4e-495f-979b-7594fd75e691 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.313837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.315562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.315562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.315562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.315838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.318139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7e76-0485-4485-b7aa-925d7c4f9dc3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.394767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b8fef-574d-4e04-b1f3-40e948925af9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.399700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.400345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.400623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.400904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] PATH_INFO: `/v3/projects/797fef3a43d54404bc46394ca7b37715` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.402036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797fef3a43d54404bc46394ca7b37715)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.403961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.428585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1020/2033] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:32.432257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765a91-c471-4446-8999-c94a3f2c6ac7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.432257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765a91-c471-4446-8999-c94a3f2c6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.432257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765a91-c471-4446-8999-c94a3f2c6ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.453384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-47765a91-c471-4446-8999-c94a3f2c6ac7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.456240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-47765a91-c471-4446-8999-c94a3f2c6ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.462933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1021/2034] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:32.464213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.464501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.464775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.486357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.487664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.498765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1022/2035] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:32.498765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.502346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.512088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc3350-a19f-47b7-b01a-33d54b5a716a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.516849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.518063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.518355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.518629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.519315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.521006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a6da-7965-428b-9dcf-d65638262bf0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.534277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1023/2036] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:32.534277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.534277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.534277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.547929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797fef3a43d54404bc46394ca7b37715', 'request_id': 'req-346fc1aa-996d-4974-9883-46f580c139d2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.554063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797fef3a43d54404bc46394ca7b37715', 'request_id': 'req-346fc1aa-996d-4974-9883-46f580c139d2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.555021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.557293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.623988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1024/2037] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:32.624928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.629154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797fef3a43d54404bc46394ca7b37715', 'request_id': 'req-346fc1aa-996d-4974-9883-46f580c139d2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.636273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f2034-c6e8-43d2-a428-5c8ec9ec25f8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.641881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.642759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.643120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.643228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] The token cache is being invalidate because project 797fef3a43d54404bc46394ca7b37715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:32.643441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.643584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.644131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:32.644439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:32.644578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.646215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.646484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1014/2038] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:32 2022] DELETE /identity/v3/projects/797fef3a43d54404bc46394ca7b37715 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:32.647514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.652884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.667822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fc1aa-996d-4974-9883-46f580c139d2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.673156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.673780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.674063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.674335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.675089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.676649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbda490-2a6f-41c0-b753-dc11179b17b8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.682138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1025/2039] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:32.683234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.687225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.692359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1015/2040] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:32.692359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.692359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.692359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.704419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd021a4-a8d9-4fb4-86ed-61f07257f4a6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.711830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.712792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.713182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.713440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.713574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.714366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:32.714754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.714876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.716623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.726900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1016/2041] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:32.728876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.731284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:32.734495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1026/2042] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:32.735998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:32.742702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:32.749073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620bf1-8a43-443a-9377-3322999b5a53 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.749236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f70fc-0f7e-478d-affc-d6681296a5ca admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:32.754778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.755015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:32.755643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.756254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.756383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.756491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.756596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.756694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] PATH_INFO: `/v3/projects/f5ba0fd1d5c74bc89359a11064943beb/users/b900f911b30a4de8a915665a653d8bf2/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.757290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.759328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f6329-4e76-4552-a179-74eedddcb0e7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.779260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ba0fd1d5c74bc89359a11064943beb, user_id=b900f911b30a4de8a915665a653d8bf2, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:32.782374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:32.804827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:32.935335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1017/2043] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:32.937036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:32.937602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:32.938095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:32.963072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:32.964957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.004519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1027/2044] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:32 2022] PUT /identity/v3/projects/f5ba0fd1d5c74bc89359a11064943beb/users/b900f911b30a4de8a915665a653d8bf2/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:33.004519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.061178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1018/2045] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:33.061178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.070144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9432-e70c-4733-a2e0-9fdc20f6ceda None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.075989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.076134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cc023-1ace-4d77-a0c7-0d6ac3c8ec11 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.076596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.076872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.077178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.077957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.080041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.081798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.082761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.083117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.083465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.084175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.086233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f593a-05ab-4f62-abc8-6880b7dff76a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.244853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1019/2046] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:33 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:33.248197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.248197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.260245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c5ef2-6620-4043-924f-621ca4f20814 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.265000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.265627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.265905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.266182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] PATH_INFO: `/v3/projects/278a6a49dd9a4b25943e77ed014b72d9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.267338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=278a6a49dd9a4b25943e77ed014b72d9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.269236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.289305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1028/2047] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:32 2022] POST /identity/v3/projects => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:33.290717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.290985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.291696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.335809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] MFA Rules not processed for user `b900f911b30a4de8a915665a653d8bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:33.337590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.403070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278a6a49dd9a4b25943e77ed014b72d9', 'request_id': 'req-3de40398-e8e2-4329-b6d6-014811dba75e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:33.410489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278a6a49dd9a4b25943e77ed014b72d9', 'request_id': 'req-3de40398-e8e2-4329-b6d6-014811dba75e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:33.421726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1029/2048] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:33.423855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.484269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278a6a49dd9a4b25943e77ed014b72d9', 'request_id': 'req-3de40398-e8e2-4329-b6d6-014811dba75e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:33.491222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9312c-855f-485d-ac6e-d6914b1f4d04 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.497874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] The token cache is being invalidate because project 278a6a49dd9a4b25943e77ed014b72d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:33.498301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:33.499194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:33.500714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1020/2049] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:33 2022] DELETE /identity/v3/projects/278a6a49dd9a4b25943e77ed014b72d9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:33.501464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.502947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.553321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.554189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.554464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.554747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.556549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:33.556857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.559008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.572251 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1030/2050] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:33.573974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.577942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.583758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de40398-e8e2-4329-b6d6-014811dba75e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.593798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33344ecb-e78a-4d8a-be17-d6d7b1af8c84 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.596437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.600496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.600637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.600770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.600861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.600947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.601036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.601036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.601196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.601284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.603717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.605019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.620692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1021/2051] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:33.623500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.624388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.639438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21797-888f-4928-8de1-f70507710be8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.647761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.648438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.648726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.649798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.650657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.652802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.708272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1031/2052] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:33 2022] POST /identity/v3/users => generated 280 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:33.708272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.710550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.731971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aee24-7d96-4b94-95d2-c3ade892f276 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.737478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.738117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.738403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.738708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] PATH_INFO: `/v3/users/a6ddf6d3fce74d499c6adac8b1585c67` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.739933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ddf6d3fce74d499c6adac8b1585c67)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.741970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.772033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1022/2053] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:33 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:33.773070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:33.776228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:33.851004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd263f-3df1-4dfa-8d49-b41988ad7e3a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:33.858698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:33.858698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:33.858698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:33.859571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:33.860407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:33.862450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:33.999616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1023/2054] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:33 2022] POST /identity/v3/projects => generated 369 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:34.000523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.009242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ddf6d3fce74d499c6adac8b1585c67'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:34.016722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ddf6d3fce74d499c6adac8b1585c67'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:34.088713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325bf17-c7e9-46b6-aade-9945a6dc4e75 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.094221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.094560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.094878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.095151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.095845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.097687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.111964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1024/2055] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.111964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.114874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ddf6d3fce74d499c6adac8b1585c67'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:34.117369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ddf6d3fce74d499c6adac8b1585c67'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:34.129144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3efa5a-f416-4c7e-9313-9dd639358e41 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.136337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.137049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.137403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.137743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.138512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.151497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.152098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ddf6d3fce74d499c6adac8b1585c67'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:34.153687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1025/2056] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.157954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.157954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.169460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1032/2057] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:33 2022] DELETE /identity/v3/users/a6ddf6d3fce74d499c6adac8b1585c67 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:34.170425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.174207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a441a-34cb-4b52-93af-f92e202ce046 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.175302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.236718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.237440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.237843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.238216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.238999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.241084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.282421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e2a9-c820-4f39-9690-d09be23db88e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.286544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.287199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.287481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.287814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.288572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.293315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.353887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1026/2058] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:34 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:34.355573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.357843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.370343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d2c2-f0af-4c08-9bbe-94798aa26565 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.375235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.375882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.376164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.376439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] PATH_INFO: `/v3/projects/911caf81bc4a437cb96b1001e4866858/users/2e56d0f37a7d44b7b89c302c2ab79739/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.391489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911caf81bc4a437cb96b1001e4866858, user_id=2e56d0f37a7d44b7b89c302c2ab79739, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.394247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.403606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1033/2059] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:34 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:34.403606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.404196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.417208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5f0f-9029-4be6-83a6-de84323ac36e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.443077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.444459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.445055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.445471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.446489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.449397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.475116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1034/2060] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.476618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.488784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1027/2061] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:34 2022] PUT /identity/v3/projects/911caf81bc4a437cb96b1001e4866858/users/2e56d0f37a7d44b7b89c302c2ab79739/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:34.490604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.492711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99f086-f349-4403-9856-5da1bc2b3a55 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.585908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.587140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.587433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.588054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.589012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.591494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.596270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c71c-0255-429e-a28e-369def35f060 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.610074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1035/2062] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.611107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.619298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.620700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.620994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.621704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.623462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.624289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64ce7-c8e5-443a-ab12-3d1a3970b7a1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.631199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.632182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.632382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.632985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] PATH_INFO: `/v3/projects/a6dab3b7d3dc4c28b5bfd22c56f93ba7/users/e0bbfb9214d54f3f98514adfc6576355/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.633536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aab12-b1cd-47c3-9988-48e26c41abde admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.647355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1028/2063] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.653106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.653387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.653656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.657477 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6dab3b7d3dc4c28b5bfd22c56f93ba7, user_id=e0bbfb9214d54f3f98514adfc6576355, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.660628 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.684235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] MFA Rules not processed for user `2e56d0f37a7d44b7b89c302c2ab79739`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:34.693102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.748937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1036/2064] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:34 2022] PUT /identity/v3/projects/a6dab3b7d3dc4c28b5bfd22c56f93ba7/users/e0bbfb9214d54f3f98514adfc6576355/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:34.750013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.807550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1029/2065] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:34.811871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.823721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdcf6-4a1e-4f31-bb8c-2dab9ee44060 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.838355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370355-2f79-4765-bb93-8befd25f004f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.843157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.845921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.845921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.845921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] PATH_INFO: `/v3/projects/75cf9233969f4c4e905154a51aa11c1a/users/faddb9a6fc764483971c8ca5d4d0ab27/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.860637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cf9233969f4c4e905154a51aa11c1a, user_id=faddb9a6fc764483971c8ca5d4d0ab27, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.863372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096e0bf-c4ea-4236-80dd-f5a5cb1ccf01 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.898569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.899454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.899721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.899994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.900640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.902223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.912127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1030/2066] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:34.912892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:34.915141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:34.927539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ef8e-770f-4d58-acf7-997aa1ba5a5d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:34.932872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:34.933485 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.933764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.934034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] PATH_INFO: `/v3/projects/04b8572337af4a9b8dfe843a3a5218e8` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:34.935268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b8572337af4a9b8dfe843a3a5218e8)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:34.937169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:34.971388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1037/2067] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:34 2022] PUT /identity/v3/projects/75cf9233969f4c4e905154a51aa11c1a/users/faddb9a6fc764483971c8ca5d4d0ab27/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:34.972620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:34.973151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:34.973151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.005041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] MFA Rules not processed for user `e0bbfb9214d54f3f98514adfc6576355`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:35.006694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.011089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:35.080273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b8572337af4a9b8dfe843a3a5218e8', 'request_id': 'req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.085449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1038/2068] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:35.086959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.088736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.089783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b8572337af4a9b8dfe843a3a5218e8', 'request_id': 'req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.104383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:35.181722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b8572337af4a9b8dfe843a3a5218e8', 'request_id': 'req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.203287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] The token cache is being invalidate because project 04b8572337af4a9b8dfe843a3a5218e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:35.203913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.204754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.207209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa92db4-561f-4063-a316-8486b611e78a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.210302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1031/2069] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:34 2022] DELETE /identity/v3/projects/04b8572337af4a9b8dfe843a3a5218e8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:35.211986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.214425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.314027 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.314836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.316530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.317147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.320063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.347405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d9d-1cc0-4cb1-bc94-0cd397ee60a4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.374483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.375193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.375474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.375964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] PATH_INFO: `/v3/projects/db715d5aecaf44ee877bb3c61c924e09/users/d0c5965f5b474182a6b9b23e9dc8be41/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.413915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db715d5aecaf44ee877bb3c61c924e09, user_id=d0c5965f5b474182a6b9b23e9dc8be41, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.417412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e2ce4-e097-4fb2-bc7c-c28ca6d098a8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.440703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.442284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.453443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1039/2070] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:35.454278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.456640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.471468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2b49a-6517-4cf4-be92-bc15c7581229 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.476748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.477549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.477948 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.479199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.479877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.481112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.493408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1040/2071] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:35.494475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.496497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.501806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1032/2072] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:35 2022] PUT /identity/v3/projects/db715d5aecaf44ee877bb3c61c924e09/users/d0c5965f5b474182a6b9b23e9dc8be41/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:35.503046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.510948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.510948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.511383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056c89-5967-4622-bdf5-eb4ae6ecc141 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.533128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:35.534367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.572160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.573530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.573530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.573530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.575567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.609568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1033/2073] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:35.610609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.611991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.627000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90077e5-e79c-4a2c-8056-acba33e3afc8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.633655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.633655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.633655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.633655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] PATH_INFO: `/v3/users/2e56d0f37a7d44b7b89c302c2ab79739` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.634315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e56d0f37a7d44b7b89c302c2ab79739)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.636286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.649184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.651505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.663876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1041/2074] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:35.665227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.676893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e4ee-b236-473d-b048-f8e25eaaf7cb service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.683684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.684349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.684629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.685167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] PATH_INFO: `/v3/projects/75cf9233969f4c4e905154a51aa11c1a/users/faddb9a6fc764483971c8ca5d4d0ab27/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.686945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cf9233969f4c4e905154a51aa11c1a, user_id=faddb9a6fc764483971c8ca5d4d0ab27, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.689704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72558a07-3dc1-45f0-92c5-f477589df737 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.700927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1042/2075] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:35 2022] PUT /identity/v3/projects/75cf9233969f4c4e905154a51aa11c1a/users/faddb9a6fc764483971c8ca5d4d0ab27/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:35.702203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2552e3-a622-4ba7-be3f-90d1819211ea None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.702554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2552e3-a622-4ba7-be3f-90d1819211ea None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.702888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2552e3-a622-4ba7-be3f-90d1819211ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.737233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-da2552e3-a622-4ba7-be3f-90d1819211ea None None] MFA Rules not processed for user `d0c5965f5b474182a6b9b23e9dc8be41`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:35.739109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-da2552e3-a622-4ba7-be3f-90d1819211ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.803762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1043/2076] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:35.805114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.805526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.807406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.827166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:35.828311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.850377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e56d0f37a7d44b7b89c302c2ab79739'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.859332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e56d0f37a7d44b7b89c302c2ab79739'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.891042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1044/2077] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:35.891903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:35.895255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:35.908091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eaeba-ae1b-44d8-af5b-828f43d668f7 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:35.912790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:35.913411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.913693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.913966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] PATH_INFO: `/v3/users/e0bbfb9214d54f3f98514adfc6576355` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.915501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0bbfb9214d54f3f98514adfc6576355)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:35.917535 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:35.935978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e56d0f37a7d44b7b89c302c2ab79739'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.951199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e56d0f37a7d44b7b89c302c2ab79739'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.952082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-47a43d32-e6f5-422f-914c-c5595a61635a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e56d0f37a7d44b7b89c302c2ab79739'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:35.958110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1034/2078] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:35 2022] DELETE /identity/v3/users/2e56d0f37a7d44b7b89c302c2ab79739 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:35.959558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:35.959844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:35.960114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:35.988222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] MFA Rules not processed for user `faddb9a6fc764483971c8ca5d4d0ab27`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:35.989437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.069714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1035/2079] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:36.071946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.073292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.144760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0bbfb9214d54f3f98514adfc6576355'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:36.157735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f5286-148c-422c-a8a5-c28a4f244f9d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.165454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0bbfb9214d54f3f98514adfc6576355'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:36.166505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.167266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.167419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.167691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.168361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.170846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fce2a-e066-4e00-a5f4-a7711873ba95 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.267004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0bbfb9214d54f3f98514adfc6576355'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:36.270915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0bbfb9214d54f3f98514adfc6576355'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:36.281196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0bbfb9214d54f3f98514adfc6576355'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:36.287361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1045/2080] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:35 2022] DELETE /identity/v3/users/e0bbfb9214d54f3f98514adfc6576355 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:36.291253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.292543 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:36.294024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.307925 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1036/2081] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:36.309666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.311796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.312558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.343532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:36.344939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.399760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b62e-845c-4f94-a365-72e5a46f200c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.484383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1037/2082] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:36.484383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.495177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.536041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.536650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.537105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.537219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.538507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:36.539133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.543434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008026-6bec-47ae-af3b-446099ff3912 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.559123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1046/2083] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:36.560594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.560911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.561184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.594364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:36.596471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.598873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef09947-fa07-4368-b972-f0976ab6087d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.608208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.608432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1047/2084] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:36.608542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.608542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.608719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.608890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.608974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.609112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.622643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dc765-4b5f-49cb-8a77-286dba5c56c1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.630116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.630973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.631479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.631953 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.632823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.635723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.732731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.734080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.748713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1038/2085] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:36.752049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1048/2086] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:36.752049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.752275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.754318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.763763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dcebc-ecac-42b7-8863-d53e162db2cd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.769552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.770317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.770754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.774883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.774883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.774883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.818971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e211a7-927f-4f38-9747-b51f6b4e24f0 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.824355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.825244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.825600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.825938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.835810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.837749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.848311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1039/2087] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:36.849278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.851664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:36.853471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:36.865705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a462c-6d21-455c-acda-5d38fc723691 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.870139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.870841 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.871124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.871387 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.881832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.884061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:36.888895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1049/2088] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/projects => generated 407 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:36.889601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.894972 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1040/2089] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:36.895341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:36.906158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2b683-8f17-4ad6-bf13-c2b4f37b4705 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:36.993229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:36.994381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:36.994750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:36.995383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:36.995671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:36.998110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.003706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0081-819d-4dfe-95fa-1828d12b5ced admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.009376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.015097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.015097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.015097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.015097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.015097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.024200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1050/2090] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:37.028104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.029847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.092956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb1ee-1101-445b-9aad-77d7e3892db6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.099700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.099700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.099700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.099700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.100744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.121903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1041/2091] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:36 2022] POST /identity/v3/users => generated 304 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:37.123590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.135735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057bf12-3e92-46a5-8599-3804f21774b5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.140986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.142061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.142800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.144071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] PATH_INFO: `/v3/projects/f7027a9732fe4d479279c929d2a98617/users/bd1d2c3fbc7a4318952cbf9915cc3f65/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.161944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7027a9732fe4d479279c929d2a98617, user_id=bd1d2c3fbc7a4318952cbf9915cc3f65, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.166645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.176654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.178267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.188599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1051/2092] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:37.189621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.201115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a4c81-b5ae-46b0-a661-2467fab09d0f service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.207124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.207738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.208009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.208706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.209360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.210856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.223888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1052/2093] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:37.228243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.239346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce0d6c-b94e-40bc-af55-7818c14b11cb admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.245096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.245982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.246318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.246595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.247335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.248994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.263491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1053/2094] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:37.267798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.278041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacac4c-db04-4df9-b1a6-a5ff41c5442c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.282913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.283609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.283899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.284180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] PATH_INFO: `/v3/projects/48d55306e4a842f784ba57fbd1b52048/users/3eb5a099f54840348e5a0aa609e8bace/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.296849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1042/2095] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:37 2022] PUT /identity/v3/projects/f7027a9732fe4d479279c929d2a98617/users/bd1d2c3fbc7a4318952cbf9915cc3f65/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:37.301412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d55306e4a842f784ba57fbd1b52048, user_id=3eb5a099f54840348e5a0aa609e8bace, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.301731 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.304139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beb765-e47c-4aba-a8b4-f58a7f8b5ca4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.384919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a62d-d716-4261-8120-0d9f8dd63690 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.396281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1054/2096] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:37 2022] PUT /identity/v3/projects/48d55306e4a842f784ba57fbd1b52048/users/3eb5a099f54840348e5a0aa609e8bace/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:37.405143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.405428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.405701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.463511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] MFA Rules not processed for user `3eb5a099f54840348e5a0aa609e8bace`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:37.465186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.495977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.496622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.496905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.497180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.497896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.499486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.509438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:37.511550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1043/2097] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:37.515123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.515464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.528765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc98c9-4b0f-4df3-b801-a41ebfb64690 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.534092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.541568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.541568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.541568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] PATH_INFO: `/v3/projects/911caf81bc4a437cb96b1001e4866858` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.541568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=911caf81bc4a437cb96b1001e4866858)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.541568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.550859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1055/2098] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:37.550859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.561852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ffba2-47e4-4c04-980d-7016055ea916 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.567790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.568390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.568856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.569175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] PATH_INFO: `/v3/projects/f7027a9732fe4d479279c929d2a98617/users/bd1d2c3fbc7a4318952cbf9915cc3f65/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.571029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7027a9732fe4d479279c929d2a98617, user_id=bd1d2c3fbc7a4318952cbf9915cc3f65, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.573883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.584728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1056/2099] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:37 2022] PUT /identity/v3/projects/f7027a9732fe4d479279c929d2a98617/users/bd1d2c3fbc7a4318952cbf9915cc3f65/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:37.585538 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.591908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.654646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaba60-4799-4ca4-9c2c-a07a04816c04 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.664564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911caf81bc4a437cb96b1001e4866858', 'request_id': 'req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.671509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911caf81bc4a437cb96b1001e4866858', 'request_id': 'req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.724496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.725155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.725800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.725800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] PATH_INFO: `/v3/projects/a6dab3b7d3dc4c28b5bfd22c56f93ba7` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.726892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6dab3b7d3dc4c28b5bfd22c56f93ba7)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.729718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.856876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911caf81bc4a437cb96b1001e4866858', 'request_id': 'req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.873157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] The token cache is being invalidate because project 911caf81bc4a437cb96b1001e4866858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:37.873616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.874366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.876163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1044/2100] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:37 2022] DELETE /identity/v3/projects/911caf81bc4a437cb96b1001e4866858 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:37.877345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:37.879962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:37.884117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6dab3b7d3dc4c28b5bfd22c56f93ba7', 'request_id': 'req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.891016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6dab3b7d3dc4c28b5bfd22c56f93ba7', 'request_id': 'req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.895643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410ceb-90fe-44b6-a9d4-8ad57d898fbb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:37.898041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6dab3b7d3dc4c28b5bfd22c56f93ba7', 'request_id': 'req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.964780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:37.965475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.965635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.966034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:37.967019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:37.968841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] The token cache is being invalidate because project a6dab3b7d3dc4c28b5bfd22c56f93ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:37.969328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.969596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcc66-cf68-4714-863e-a8934baa48b2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:37.970383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-d6f41c0d-f64f-40f1-a7ab-038916aed8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:37.977728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1057/2101] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:37 2022] DELETE /identity/v3/projects/a6dab3b7d3dc4c28b5bfd22c56f93ba7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:37.979662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a566c2-ae4e-4f68-b8ac-c7a72821a449 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:37.980007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a566c2-ae4e-4f68-b8ac-c7a72821a449 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:37.980352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a566c2-ae4e-4f68-b8ac-c7a72821a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.035189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c0a566c2-ae4e-4f68-b8ac-c7a72821a449 None None] MFA Rules not processed for user `bd1d2c3fbc7a4318952cbf9915cc3f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:38.036536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c0a566c2-ae4e-4f68-b8ac-c7a72821a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.083799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1045/2102] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:37 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:38.083799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.083799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.084153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.113862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:38.116309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.122541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1058/2103] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:38.124118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.127797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.127797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.179848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:38.181984 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.205103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1046/2104] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:38.207834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.211638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.238284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d657b5-7bab-4813-8c7e-af2706a90440 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.255095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.255976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.255976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.256282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.256889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.260360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025d85-990d-4214-87cb-c8ca708966e6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.290200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1059/2105] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:38.294109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.296830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.364701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1047/2106] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:38.367007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc5c1-26ae-4fc0-93b5-e5e45a370212 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.367204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f990-eaa7-4f93-97d5-af96fd9d06d6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.368518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc5c1-26ae-4fc0-93b5-e5e45a370212 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.370684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc5c1-26ae-4fc0-93b5-e5e45a370212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.372309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.372907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.373188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.373463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.395653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-df4dc5c1-26ae-4fc0-93b5-e5e45a370212 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:38.397971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-df4dc5c1-26ae-4fc0-93b5-e5e45a370212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.408903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1048/2107] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:38.410504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.411056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.411514 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.437454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:38.438783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:38.451566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1049/2108] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:38.452818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.466240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807c3c9-32bb-498a-970b-13bc39f096b1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.472155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.473673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.474113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.474862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.475670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.475811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.478864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.479478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.491342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1060/2109] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:38.494026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1050/2110] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:38.495725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.497235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.509842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4618642-5d0b-4c8f-82d6-917390fd8da8 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.509988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf362c2-f63b-438d-8375-bd1fe91e5592 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.516309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.516478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.517306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.517425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.517541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.517631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.517711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.517898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.518216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:38.518527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.518776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:38.519293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.520235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.521039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.535545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1051/2111] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:38.536634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.541899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1061/2112] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:38.542997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.548866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d4fe-4b02-45de-b2fa-3658264ccbdc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.555643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.556113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.556481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.556827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3759-26ab-4647-a34f-15f95339992f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.557277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] PATH_INFO: `/v3/projects/eb25e78a0ec64cc786053d6fad462a65/users/2467199f0ab2463fa17d4b8766d859a1/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.562237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.562877 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.563162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.563454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.564176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.566145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.575991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb25e78a0ec64cc786053d6fad462a65, user_id=2467199f0ab2463fa17d4b8766d859a1, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.579325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.712168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1052/2113] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:38 2022] PUT /identity/v3/projects/eb25e78a0ec64cc786053d6fad462a65/users/2467199f0ab2463fa17d4b8766d859a1/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:38.713047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.726590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1062/2114] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:38.729501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.734533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:38.802666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86155aa-da5f-4c00-af40-68baff743c56 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.809386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.810118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.810630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.811102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.811906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.814001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.815492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9c43-7507-41ec-b09b-ac6622e46d3f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.820951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.824845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.824845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.824845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.824845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.824845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.836057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1063/2115] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:38.837701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:38.847846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8562-d8d8-44ed-86fc-de4b3071f6cb admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:38.853256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:38.853853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:38.854134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:38.854377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:38.855053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:38.856974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:38.949454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1053/2116] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:38.951091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.010966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1064/2117] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:38 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:39.020718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.040462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aeb15-6976-4cd0-aa8c-cb58f4c8e9cd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.046752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f550fb9-1f19-4f77-ac1e-471fe326cd53 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.053908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.055138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.055935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.056622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.058053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.058965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.059877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.060213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.060552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] PATH_INFO: `/v3/projects/eb25e78a0ec64cc786053d6fad462a65/users/2467199f0ab2463fa17d4b8766d859a1/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.062803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb25e78a0ec64cc786053d6fad462a65, user_id=2467199f0ab2463fa17d4b8766d859a1, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.063439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750fcb-b9af-4f70-865e-fe2e925f860d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.065825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.079945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1054/2118] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:38 2022] PUT /identity/v3/projects/eb25e78a0ec64cc786053d6fad462a65/users/2467199f0ab2463fa17d4b8766d859a1/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:39.080801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.179825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872932ee-ac3f-4b57-b622-ea1dc8123b8b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.185504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.186378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.186513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.186966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.187696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.189371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.193432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1065/2119] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:39 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:39.193432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.193432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.193761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.205737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1055/2120] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:39.206858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.218602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd916f-c0b2-41e7-8cb7-03766f925698 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.241482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.241907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] MFA Rules not processed for user `2467199f0ab2463fa17d4b8766d859a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:39.242059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.242295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.242610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.243346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.244262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:39.244983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.271211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1056/2121] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:39.271211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.293955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7494f0-f7fe-4116-b83f-f959dd51e2d0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.320501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.322554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.322997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.323313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.323989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.327742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.341606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1057/2122] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:39.342968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.355058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519873a5-c107-40b3-a1a3-d4083d398876 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.366711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.366711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.366711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.366711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.367208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.367208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.378700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1058/2123] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:39.379664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.393977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be632d-3121-4b56-ad52-18e617274fb4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.403211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.403211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.403517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.403908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] PATH_INFO: `/v3/projects/50705d9be8f7492a9d74a410d051ed41/users/93a35d30128147238c4032a47cedc842/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.425093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1066/2124] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:39.426130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.447718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50705d9be8f7492a9d74a410d051ed41, user_id=93a35d30128147238c4032a47cedc842, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.452191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.456436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbcc82-be55-42c9-b3ef-20f238aecf36 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.466675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.468340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.468340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.468340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] PATH_INFO: `/v3/projects/c4b6a1770cef44928644b75108340914/users/893163b1761f4c6aa0f3bd6137d0e2bf/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.496193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b6a1770cef44928644b75108340914, user_id=893163b1761f4c6aa0f3bd6137d0e2bf, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.500029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d7afb-9d99-4c4d-aa7a-3af2e5857e3e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.511851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1059/2125] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:39 2022] PUT /identity/v3/projects/50705d9be8f7492a9d74a410d051ed41/users/93a35d30128147238c4032a47cedc842/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:39.511851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.591749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1067/2126] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:39 2022] PUT /identity/v3/projects/c4b6a1770cef44928644b75108340914/users/893163b1761f4c6aa0f3bd6137d0e2bf/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:39.602140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ed11-3c4c-4da1-b943-b466670c1c42 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.605336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ed11-3c4c-4da1-b943-b466670c1c42 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.605336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ed11-3c4c-4da1-b943-b466670c1c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.619908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c60009-4aee-4947-9f94-fea504305753 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.634429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a5a3ed11-3c4c-4da1-b943-b466670c1c42 None None] MFA Rules not processed for user `93a35d30128147238c4032a47cedc842`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:39.635923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5a3ed11-3c4c-4da1-b943-b466670c1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:39.674911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:39.699893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.705470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.705470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.705470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.724322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1068/2127] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:39.724322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.724322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.724322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.759529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] MFA Rules not processed for user `893163b1761f4c6aa0f3bd6137d0e2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:39.761347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:39.782778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.784108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.805279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1060/2128] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:39.839269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:39.840779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:39.853180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1069/2129] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:39.860061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbe9e-e1ea-4f28-9690-98b60097f602 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:39.869128 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:39.869761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:39.870041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:39.870313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:39.896563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:39.900341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:39.929144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1061/2130] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:40.290530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:40.300576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3bd3-dea6-49aa-a7d4-65606d724d06 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:40.304311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:40.305074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:40.305512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:40.305757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:40.314780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:40.316531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:40.329999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1070/2131] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:41.061600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:41.268558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:41.362025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:41.375013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a115de-9702-4b93-8972-2a32fbaf0032 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:41.384498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:41.388774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:41.388774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:41.388774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:41.388774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:41.452575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:41.454041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:41.462836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1062/2132] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:41 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:43.681438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:43.683003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:43.690354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:43.750392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb35c26-ad81-4c01-a04a-fdac747035d1 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:43.754988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:43.755609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:43.755888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:43.756159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] PATH_INFO: `/v3/users/93a6ff3696014b9eb0ce7eab09922e8e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:43.757294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a6ff3696014b9eb0ce7eab09922e8e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:43.759646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:43.901447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:43.976617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a6ff3696014b9eb0ce7eab09922e8e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:43.984126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a6ff3696014b9eb0ce7eab09922e8e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.073101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a6ff3696014b9eb0ce7eab09922e8e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.073788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a6ff3696014b9eb0ce7eab09922e8e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.088596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a6ff3696014b9eb0ce7eab09922e8e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.098225 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1071/2133] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:43 2022] DELETE /identity/v3/users/93a6ff3696014b9eb0ce7eab09922e8e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:44.378151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:44.392900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b7e7d-428a-4356-a3df-fe567f9e3462 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:44.434255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:44.435689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:44.497612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:44.498357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.498550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.499195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] PATH_INFO: `/v3/projects/54ab2e6750c04628b467daea0ea08e37` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:44.500681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab2e6750c04628b467daea0ea08e37)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:44.502651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:44.532231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae654-22e5-4dec-acfa-fe13bfe268ae admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:44.538127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:44.538833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.539167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.539749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] PATH_INFO: `/v3/users/93a35d30128147238c4032a47cedc842` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:44.541020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a35d30128147238c4032a47cedc842)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:44.543763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:44.639878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab2e6750c04628b467daea0ea08e37', 'request_id': 'req-d53461c3-0b2d-475d-9a86-2432450d1d04'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.649373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab2e6750c04628b467daea0ea08e37', 'request_id': 'req-d53461c3-0b2d-475d-9a86-2432450d1d04'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.718552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab2e6750c04628b467daea0ea08e37', 'request_id': 'req-d53461c3-0b2d-475d-9a86-2432450d1d04'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.745311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] The token cache is being invalidate because project 54ab2e6750c04628b467daea0ea08e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:44.745724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.746435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.749542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1063/2134] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:44 2022] DELETE /identity/v3/projects/54ab2e6750c04628b467daea0ea08e37 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:44.749542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:44.751883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:44.753174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a35d30128147238c4032a47cedc842'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.763274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a35d30128147238c4032a47cedc842'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.824170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53461c3-0b2d-475d-9a86-2432450d1d04 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:44.829351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:44.829988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.830267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.830541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] PATH_INFO: `/v3/users/f2637de2ce614673b19281880a7bc9c9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:44.833543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2637de2ce614673b19281880a7bc9c9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:44.833828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:44.852857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a35d30128147238c4032a47cedc842'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.853652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a35d30128147238c4032a47cedc842'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.872886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-93381eed-0577-464c-be40-f18b216f8083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a35d30128147238c4032a47cedc842'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:44.879418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1072/2135] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:44 2022] DELETE /identity/v3/users/93a35d30128147238c4032a47cedc842 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:44.880912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8ea9-d554-488d-b836-06d919f638e7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.881314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8ea9-d554-488d-b836-06d919f638e7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.881664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8ea9-d554-488d-b836-06d919f638e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:44.902388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7c9f8ea9-d554-488d-b836-06d919f638e7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:44.903727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7c9f8ea9-d554-488d-b836-06d919f638e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:44.965450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1073/2136] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:44.966930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0a82-3312-449d-a23a-b94de06c5796 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.967216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0a82-3312-449d-a23a-b94de06c5796 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.967491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0a82-3312-449d-a23a-b94de06c5796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:44.988016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-82fe0a82-3312-449d-a23a-b94de06c5796 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:44.988683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-82fe0a82-3312-449d-a23a-b94de06c5796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:44.997389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1074/2137] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:44.998365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:44.998645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:44.998951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.020637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:45.021831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.031130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1075/2138] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:45.031918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.033200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.057458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2637de2ce614673b19281880a7bc9c9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:45.064535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2637de2ce614673b19281880a7bc9c9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:45.095471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7f8b9-016b-46d0-b17e-9494fea80b90 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.099202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.099834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.100112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.100384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.112478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.113979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.120434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2637de2ce614673b19281880a7bc9c9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:45.126305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1076/2139] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:45.127022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.137510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf5e71-5a5d-482d-b27e-04f0b11e7c92 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.142603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.143252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.143539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.143826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.144484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:45.144796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.146451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.161300 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1077/2140] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:45.169507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2637de2ce614673b19281880a7bc9c9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:45.170844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.170948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3f1e88d9-2400-4749-b12d-d8376bb34d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2637de2ce614673b19281880a7bc9c9'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:45.172097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.192927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1064/2141] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:44 2022] DELETE /identity/v3/users/f2637de2ce614673b19281880a7bc9c9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:45.198174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.198524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.198897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.210897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cef8-5296-40b5-8d64-4e6bab70e52c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.249236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:45.249236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.291958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.293191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.293930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.294961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.295787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.297827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.316328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1065/2142] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:45.327160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.333728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.395637 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfc6f1-edc2-4c6a-8a57-38487eb0579d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.404998 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1078/2143] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:45.406183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.406743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.407043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.407307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.409534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.419377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.421000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.449422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1066/2144] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:45.528794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ca-8f80-4143-bff6-b8037e199c3d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.535313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.536326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.536641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.536921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.537567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.540254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.658239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1079/2145] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:45 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:45.662475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.689468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.691762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:45.712858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738bc81-395a-48b9-a7d4-2109c6aa1dab service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.728854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.729542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.729736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.731943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.732936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.734938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.738392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735104f-2694-413f-a3ad-0d841c0b5b1c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.756136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1067/2146] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:45.757234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.757348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.757936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.758837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.759114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] PATH_INFO: `/v3/projects/50705d9be8f7492a9d74a410d051ed41` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.763549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50705d9be8f7492a9d74a410d051ed41)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.765994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.781508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fff100-0845-424f-937f-9b669c622cad admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.786645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.787286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.787634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.787970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.788813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.791205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.806259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1068/2147] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:45.809147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:45.819024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be07a-29fd-401a-b0bb-f9ea32a598e1 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:45.825362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:45.825814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.826088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.826354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] PATH_INFO: `/v3/projects/bb9a70459fef46a9bedfec1b038027a3/users/0fc9a7bfd2dc48a6ab96957b23b45eeb/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.842078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9a70459fef46a9bedfec1b038027a3, user_id=0fc9a7bfd2dc48a6ab96957b23b45eeb, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:45.844801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba73e9b-7e5d-4d8f-839c-ce9adb6893ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:45.969623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1069/2148] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:45 2022] PUT /identity/v3/projects/bb9a70459fef46a9bedfec1b038027a3/users/0fc9a7bfd2dc48a6ab96957b23b45eeb/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:45.977470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:45.977757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:45.978038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:45.991086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50705d9be8f7492a9d74a410d051ed41', 'request_id': 'req-e1fe218a-1ed3-44a1-b43f-07b3de420721'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.002023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50705d9be8f7492a9d74a410d051ed41', 'request_id': 'req-e1fe218a-1ed3-44a1-b43f-07b3de420721'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.010022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:46.011362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.015859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50705d9be8f7492a9d74a410d051ed41', 'request_id': 'req-e1fe218a-1ed3-44a1-b43f-07b3de420721'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.081388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1070/2149] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:46.082864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.083782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.093172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] The token cache is being invalidate because project 50705d9be8f7492a9d74a410d051ed41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:46.093485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.094604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.096865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a0b5-6bec-4626-a704-9daeaac55f3c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.098782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1080/2150] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:45 2022] DELETE /identity/v3/projects/50705d9be8f7492a9d74a410d051ed41 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:46.100993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.103941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.104754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.105953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.106317 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.106660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] PATH_INFO: `/v3/projects/8849efa09aa24ab28e63cc6eebda923f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.108304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8849efa09aa24ab28e63cc6eebda923f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.110692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.120098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe218a-1ed3-44a1-b43f-07b3de420721 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.125010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.125752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.125916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.126160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] PATH_INFO: `/v3/users/d0c5965f5b474182a6b9b23e9dc8be41` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.127382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c5965f5b474182a6b9b23e9dc8be41)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.129351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.206351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8849efa09aa24ab28e63cc6eebda923f', 'request_id': 'req-1f5093fb-aeae-410f-afcd-9c2c85985bb7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.212247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8849efa09aa24ab28e63cc6eebda923f', 'request_id': 'req-1f5093fb-aeae-410f-afcd-9c2c85985bb7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.312757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8849efa09aa24ab28e63cc6eebda923f', 'request_id': 'req-1f5093fb-aeae-410f-afcd-9c2c85985bb7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.326984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] The token cache is being invalidate because project 8849efa09aa24ab28e63cc6eebda923f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:46.327283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.328022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.329229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c5965f5b474182a6b9b23e9dc8be41'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.332632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1071/2151] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:46 2022] DELETE /identity/v3/projects/8849efa09aa24ab28e63cc6eebda923f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:46.332632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.332632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.337246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c5965f5b474182a6b9b23e9dc8be41'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.395553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5093fb-aeae-410f-afcd-9c2c85985bb7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.400011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.400532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.400811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.401082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.402857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.432407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c5965f5b474182a6b9b23e9dc8be41'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.433078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c5965f5b474182a6b9b23e9dc8be41'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.451340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e9589e7d-7a3b-48da-b095-04b8e3b97f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c5965f5b474182a6b9b23e9dc8be41'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.457607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1081/2152] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:46 2022] DELETE /identity/v3/users/d0c5965f5b474182a6b9b23e9dc8be41 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:46.458853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.459303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.460079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.474662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.476180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.482986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:46.484258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.486957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1072/2153] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:46.487840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.499885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.547188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c58441-ad9b-47f9-8067-30e9428cf0ff service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.550472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1082/2154] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:46.551415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.552681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.569406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d80a57-103d-463a-b5dd-1e4cc61dc4c8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.570209 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.570977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.571245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.571726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] PATH_INFO: `/v3/users/b900f911b30a4de8a915665a653d8bf2` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.572692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b900f911b30a4de8a915665a653d8bf2)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.574933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.605140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.605759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.606042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.606314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.608126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.623242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:46.673320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.674810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.684956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1073/2155] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:46.685799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:46.687161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:46.703366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219979-507d-4d69-afea-8c1e7e7dda02 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:46.708232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:46.708878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:46.709160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:46.709436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] PATH_INFO: `/v3/users/893163b1761f4c6aa0f3bd6137d0e2bf` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:46.710810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893163b1761f4c6aa0f3bd6137d0e2bf)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:46.713583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:46.872000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b900f911b30a4de8a915665a653d8bf2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.875055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:46.887483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b900f911b30a4de8a915665a653d8bf2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.955308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893163b1761f4c6aa0f3bd6137d0e2bf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.966051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893163b1761f4c6aa0f3bd6137d0e2bf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.984582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b900f911b30a4de8a915665a653d8bf2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:46.984582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b900f911b30a4de8a915665a653d8bf2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:47.001550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5c169873-be8e-437d-afc8-94152129adf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b900f911b30a4de8a915665a653d8bf2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:47.008515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1083/2156] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:46 2022] DELETE /identity/v3/users/b900f911b30a4de8a915665a653d8bf2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:47.010017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ab5f-b799-410b-b89e-328dfba81655 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.013275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ab5f-b799-410b-b89e-328dfba81655 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.013275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2ab5f-b799-410b-b89e-328dfba81655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.029703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5be2ab5f-b799-410b-b89e-328dfba81655 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:47.030927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5be2ab5f-b799-410b-b89e-328dfba81655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.096010 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1084/2157] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:47.097412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2d53-ca7e-429c-b844-0fb9770b2655 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.097801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2d53-ca7e-429c-b844-0fb9770b2655 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.098083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2d53-ca7e-429c-b844-0fb9770b2655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.108843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893163b1761f4c6aa0f3bd6137d0e2bf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:47.124121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893163b1761f4c6aa0f3bd6137d0e2bf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:47.125320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893163b1761f4c6aa0f3bd6137d0e2bf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:47.126561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9eed2d53-ca7e-429c-b844-0fb9770b2655 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:47.128424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9eed2d53-ca7e-429c-b844-0fb9770b2655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.132136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1074/2158] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:46 2022] DELETE /identity/v3/users/893163b1761f4c6aa0f3bd6137d0e2bf => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:47.133096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.134668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.142119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1085/2159] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:47.144499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.145352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.145639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.169324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:47.170849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.225303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc86268-9828-411b-839c-de15c8f4b4a7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.233480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.234248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.234529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.234853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.236787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.238023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1086/2160] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:47.238763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.249176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fb4ec-b9ac-41c7-b6d5-c5555a10ceee None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.253922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.254187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.254529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.254851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.255125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.255702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.255807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:47.256042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.257636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.270385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1087/2161] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:47.271596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.276680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1075/2162] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:47.278543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.284037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d89c-21bc-49fe-b4d0-40148a9d0f22 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.288645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.290039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.290326 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.290576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a5df8-6c88-46d7-9d24-79ab777fb667 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.290692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.301852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.303331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.305899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.307267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.308070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.308738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.309448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.311541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.323758 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1088/2163] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:47.481904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1076/2164] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:47 2022] POST /identity/v3/projects => generated 399 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:47.486388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.496983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401359c9-da03-4cd8-9d26-8fae621dd925 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.564162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.564771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.565047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.565314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.565957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.567935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.652959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1089/2165] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:47 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:47.659520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.683751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4d65-ffd7-401b-9072-01f6711fefce admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.700998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.701510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.701796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.702068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.704223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.716551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.725699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.728307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:47.750585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900dd6-6fae-424a-b00b-b3481dab67df admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.758668 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.760016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.760299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.760571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] PATH_INFO: `/v3/projects/f5ba0fd1d5c74bc89359a11064943beb` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.761798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ba0fd1d5c74bc89359a11064943beb)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.761913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1077/2166] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:47.763843 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.766521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.786444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159443-f733-4194-a6ca-6253fa9e69e5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.804163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.805677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.805677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.806662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.815639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.815639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:47.823560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1078/2167] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:47.827771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:47.840257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad448c6-c52c-423b-b3f2-6442bf208852 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:47.860172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:47.861232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:47.861751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:47.862235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] PATH_INFO: `/v3/projects/570f912759944302ac9cf70147f3c44e/users/c223a6d7705d433696b11c8f962cdcec/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:47.881583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] RBAC: Authorizing `identity:create_grant(project_id=570f912759944302ac9cf70147f3c44e, user_id=c223a6d7705d433696b11c8f962cdcec, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:47.885758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:48.031305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ba0fd1d5c74bc89359a11064943beb', 'request_id': 'req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.038579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ba0fd1d5c74bc89359a11064943beb', 'request_id': 'req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.046248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ba0fd1d5c74bc89359a11064943beb', 'request_id': 'req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.047965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1079/2168] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:47 2022] PUT /identity/v3/projects/570f912759944302ac9cf70147f3c44e/users/c223a6d7705d433696b11c8f962cdcec/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:48.048892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:48.057771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:48.103598 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] The token cache is being invalidate because project f5ba0fd1d5c74bc89359a11064943beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:48.103901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.104938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.112615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1090/2169] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:47 2022] DELETE /identity/v3/projects/f5ba0fd1d5c74bc89359a11064943beb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:48.113874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:48.116131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:48.172675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:48.233824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43fb0f-50ed-4bd0-b5b9-ba570bc80905 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:48.241904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:48.243609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:48.243896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:48.244911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] PATH_INFO: `/v3/projects/db715d5aecaf44ee877bb3c61c924e09` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:48.245668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93973cf7-afb9-4bde-98d1-8de24bab690b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:48.246157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db715d5aecaf44ee877bb3c61c924e09)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:48.248407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:48.253078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:48.254229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:48.254764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:48.255407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] PATH_INFO: `/v3/projects/c4b6a1770cef44928644b75108340914` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:48.259368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b6a1770cef44928644b75108340914)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:48.263969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:48.367424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db715d5aecaf44ee877bb3c61c924e09', 'request_id': 'req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.375013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db715d5aecaf44ee877bb3c61c924e09', 'request_id': 'req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.380778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db715d5aecaf44ee877bb3c61c924e09', 'request_id': 'req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.388400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b6a1770cef44928644b75108340914', 'request_id': 'req-ca199a2f-a2f5-46e6-955f-9fe982484cb2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.393982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b6a1770cef44928644b75108340914', 'request_id': 'req-ca199a2f-a2f5-46e6-955f-9fe982484cb2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.502352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] The token cache is being invalidate because project db715d5aecaf44ee877bb3c61c924e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:48.502653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.503372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2f00e8fa-7a98-476e-8ebe-45c6cbdb5e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.505180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1091/2170] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:48 2022] DELETE /identity/v3/projects/db715d5aecaf44ee877bb3c61c924e09 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:48.506177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:48.506515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:48.506801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:48.543574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] MFA Rules not processed for user `c223a6d7705d433696b11c8f962cdcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:48.544796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:48.597132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b6a1770cef44928644b75108340914', 'request_id': 'req-ca199a2f-a2f5-46e6-955f-9fe982484cb2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.600062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] The token cache is being invalidate because project c4b6a1770cef44928644b75108340914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:48.600420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.601109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:48.602957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1080/2171] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:48 2022] DELETE /identity/v3/projects/c4b6a1770cef44928644b75108340914 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:48.618997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1092/2172] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:48.620072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:48.620481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:48.630765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:48.633707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:48.695309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:48.729815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b5577-79f3-4305-8361-f41e9b326d0e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:48.740086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:48.740739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:48.741013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:48.741281 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] PATH_INFO: `/v3/users/faddb9a6fc764483971c8ca5d4d0ab27` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:48.743873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=faddb9a6fc764483971c8ca5d4d0ab27)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:48.745930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:48.790759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199a2f-a2f5-46e6-955f-9fe982484cb2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:48.801253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:48.802091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:48.803052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:48.803351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] PATH_INFO: `/v3/users/bd1d2c3fbc7a4318952cbf9915cc3f65` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:48.807542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1d2c3fbc7a4318952cbf9915cc3f65)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:48.811291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:48.999204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faddb9a6fc764483971c8ca5d4d0ab27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.014680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1d2c3fbc7a4318952cbf9915cc3f65'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.015312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faddb9a6fc764483971c8ca5d4d0ab27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.027460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1d2c3fbc7a4318952cbf9915cc3f65'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.112188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faddb9a6fc764483971c8ca5d4d0ab27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.112869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faddb9a6fc764483971c8ca5d4d0ab27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.129414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faddb9a6fc764483971c8ca5d4d0ab27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.158641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1093/2173] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:48 2022] DELETE /identity/v3/users/faddb9a6fc764483971c8ca5d4d0ab27 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:49.171890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1d2c3fbc7a4318952cbf9915cc3f65'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.174828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:49.179513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:49.210776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1d2c3fbc7a4318952cbf9915cc3f65'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.210776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1d2c3fbc7a4318952cbf9915cc3f65'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:49.221082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1081/2174] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:48 2022] DELETE /identity/v3/users/bd1d2c3fbc7a4318952cbf9915cc3f65 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:49.279594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8ad3-3d8a-48da-bafd-2e8b1157d06d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:49.351730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:49.352882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:49.353592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:49.353893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:49.356387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:49.432623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:49.434882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:49.444262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1094/2175] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:49.524124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:49.795742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:49.797241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:49.892646 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be681-b01e-4998-bb0d-809175eb4a17 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:49.897628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:49.898258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:49.899135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:49.899751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] PATH_INFO: `/v3/users/3eb5a099f54840348e5a0aa609e8bace` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:49.901295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb5a099f54840348e5a0aa609e8bace)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:49.903489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:49.940262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:49.942335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:49.968571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c870ca-d9df-4927-9172-7e63e4341124 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:49.976126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:49.982909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:49.982909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:49.982909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] PATH_INFO: `/v3/projects/75cf9233969f4c4e905154a51aa11c1a` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:49.982909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cf9233969f4c4e905154a51aa11c1a)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:49.986306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:50.208669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb5a099f54840348e5a0aa609e8bace'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.209977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cf9233969f4c4e905154a51aa11c1a', 'request_id': 'req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.221749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb5a099f54840348e5a0aa609e8bace'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.225509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cf9233969f4c4e905154a51aa11c1a', 'request_id': 'req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.235769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cf9233969f4c4e905154a51aa11c1a', 'request_id': 'req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.307632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb5a099f54840348e5a0aa609e8bace'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.322389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb5a099f54840348e5a0aa609e8bace'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.323223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb5a099f54840348e5a0aa609e8bace'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.333464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1082/2176] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:49 2022] DELETE /identity/v3/users/3eb5a099f54840348e5a0aa609e8bace => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:50.334371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:50.335889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.391909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] The token cache is being invalidate because project 75cf9233969f4c4e905154a51aa11c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:50.392508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.393446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff3f8f9a-a2aa-473b-82e6-04337d1cb115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.396077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1095/2177] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:49 2022] DELETE /identity/v3/projects/75cf9233969f4c4e905154a51aa11c1a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:50.397874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea116-79a0-4e93-9dbe-576100315ad8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.398834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea116-79a0-4e93-9dbe-576100315ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.399392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bea116-79a0-4e93-9dbe-576100315ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.419233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:50.447546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9c4d-e63e-4e0c-bef0-c5f5dabdee6f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:50.458795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:50.458795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.458795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.458795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] PATH_INFO: `/v3/projects/f7027a9732fe4d479279c929d2a98617` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.466472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7027a9732fe4d479279c929d2a98617)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:50.472831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:50.487701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-13bea116-79a0-4e93-9dbe-576100315ad8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:50.489328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-13bea116-79a0-4e93-9dbe-576100315ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.502912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1096/2178] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:50.504473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.504912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.505384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.567123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:50.569790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.582327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1097/2179] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:50.591106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:50.597938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.633950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7027a9732fe4d479279c929d2a98617', 'request_id': 'req-6b1192d3-1265-4418-bc79-2942f0562d1d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.642307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7027a9732fe4d479279c929d2a98617', 'request_id': 'req-6b1192d3-1265-4418-bc79-2942f0562d1d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.667721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2f5ec-bf92-472e-8a7c-20a4c37b25ba None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:50.700810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7027a9732fe4d479279c929d2a98617', 'request_id': 'req-6b1192d3-1265-4418-bc79-2942f0562d1d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.722270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] The token cache is being invalidate because project f7027a9732fe4d479279c929d2a98617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:50.722591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.723636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-6b1192d3-1265-4418-bc79-2942f0562d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:50.725086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1083/2180] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:50 2022] DELETE /identity/v3/projects/f7027a9732fe4d479279c929d2a98617 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:50.726560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42d86-cbb9-4c5a-9d2a-b4bb0aae4663 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.727402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42d86-cbb9-4c5a-9d2a-b4bb0aae4663 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.728107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa42d86-cbb9-4c5a-9d2a-b4bb0aae4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.743573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:50.744925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.745204 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.745961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.747875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.761070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0fa42d86-cbb9-4c5a-9d2a-b4bb0aae4663 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:50.762318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0fa42d86-cbb9-4c5a-9d2a-b4bb0aae4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.842942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:50.844404 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:50.872280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1084/2181] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:50.873933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc2bb-4a4a-4f54-aaf7-f184cd637184 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.874225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc2bb-4a4a-4f54-aaf7-f184cd637184 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.874500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc2bb-4a4a-4f54-aaf7-f184cd637184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.884426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:50.899439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1098/2182] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:50.901979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:50.902287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-064fc2bb-4a4a-4f54-aaf7-f184cd637184 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:50.903945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-064fc2bb-4a4a-4f54-aaf7-f184cd637184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.915029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1085/2183] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:50.918359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0026-c41f-470c-a390-2b74573a2e91 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:50.922470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.927098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:50.927098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:50.927098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.927098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.927442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:50.927442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:50.928599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:50.929317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:50.930305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:50.948852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1099/2184] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:50.970322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:50.978294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:50.983880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:50.990533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5e94-ffa3-43dc-9f8a-06230e41b78e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.012171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1086/2185] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:51.012941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.016918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.017146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.017240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.017240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.017421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.036275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.054963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163e888-0234-4154-99c2-27d8dffa82f6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.068243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.068874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.069154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.069424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.070081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:51.070453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.073946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.098278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1087/2186] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:51.099458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.118109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955379-db48-4d8a-9b1d-14862c38cd0d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.123802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.124632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.125099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.125517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.126403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.128476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.190045 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1100/2187] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:50 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:51.194393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.224613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1088/2188] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:51 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:51.230699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.296170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f957d-29b4-4894-912b-209e06b73888 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.343655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770eab5-e889-45c2-b2bb-86f5fa24d138 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.350012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.350012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.350012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.350366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.358356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.360437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.363784 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.364641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.366041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.366656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.368022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.369905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.486480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1101/2190] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:51 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:51.490659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1089/2190] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:51 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:51.492977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.494281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.514154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded2b3e-bf8a-424d-8dab-3d323c1b08ae admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.517971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148767-d9c6-4b6d-90fc-339193b14b32 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.522055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.523136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.523513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.524469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.525105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.526718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.539299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1090/2191] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:51.539817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.540673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.542980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.543267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.543527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:51.543629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.544235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.545938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.568625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189700-69f3-4d2c-adca-eb21da09c7b8 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.568625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.568625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.568625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.568938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1102/2192] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:51.568938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.569078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] PATH_INFO: `/v3/projects/48d55306e4a842f784ba57fbd1b52048` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.571701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d55306e4a842f784ba57fbd1b52048)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.574432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.578154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd176-a736-4647-b9ec-0d74ee2672b6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.583707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.584559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.584844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.585120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.585778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.588011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.599599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1103/2193] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:51.600540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.611117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4010d37-c291-4c5a-bb3e-84d45750b11f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.616581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.617168 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.617996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.618271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.620003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.620802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.637828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1104/2194] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:51.637828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.658584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeba5e-5cc8-4816-aa21-66f0da1a56fb admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.664082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.665253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.665669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.666033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] PATH_INFO: `/v3/projects/41593d1ed60d4aa5abfa4cc04034976d/users/61bfe15af6cb4796ac2327cc410b796d/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.703489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=41593d1ed60d4aa5abfa4cc04034976d, user_id=61bfe15af6cb4796ac2327cc410b796d, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.708015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.737516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d55306e4a842f784ba57fbd1b52048', 'request_id': 'req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:51.744686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d55306e4a842f784ba57fbd1b52048', 'request_id': 'req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:51.780510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1105/2195] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:51 2022] PUT /identity/v3/projects/41593d1ed60d4aa5abfa4cc04034976d/users/61bfe15af6cb4796ac2327cc410b796d/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:51.781223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.815721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d55306e4a842f784ba57fbd1b52048', 'request_id': 'req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:51.837853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] The token cache is being invalidate because project 48d55306e4a842f784ba57fbd1b52048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:51.838509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:51.839548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-967a9f99-5fa5-4b68-b4a5-ffeaef7c1594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:51.846087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1091/2196] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:51 2022] DELETE /identity/v3/projects/48d55306e4a842f784ba57fbd1b52048 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:51.848871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad310f6f-a7ae-48bd-a93a-cdc038feec2d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.849914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad310f6f-a7ae-48bd-a93a-cdc038feec2d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.850369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad310f6f-a7ae-48bd-a93a-cdc038feec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.871604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182025b-036f-40a7-8140-3ec64c59dddd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:51.877291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:51.878360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:51.878766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:51.879139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] PATH_INFO: `/v3/projects/fe1e28643fe64e8f856ed6f67e2106bb/users/44bcc4b6c3f248f1ae185de46881da74/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:51.886857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ad310f6f-a7ae-48bd-a93a-cdc038feec2d None None] MFA Rules not processed for user `61bfe15af6cb4796ac2327cc410b796d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:51.890846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ad310f6f-a7ae-48bd-a93a-cdc038feec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:51.900688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e28643fe64e8f856ed6f67e2106bb, user_id=44bcc4b6c3f248f1ae185de46881da74, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:51.903804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:51.970295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1106/2197] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:51 2022] PUT /identity/v3/projects/fe1e28643fe64e8f856ed6f67e2106bb/users/44bcc4b6c3f248f1ae185de46881da74/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:51.971175 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:51.982561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.053274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1092/2198] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:52.054783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.055074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.055347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.119318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] MFA Rules not processed for user `44bcc4b6c3f248f1ae185de46881da74`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:52.120818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.154774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8157b-2a1f-4c5e-b0d1-aa64c5d61059 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.162084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.162809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.163100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.163377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] PATH_INFO: `/v3/users/2467199f0ab2463fa17d4b8766d859a1` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.165434 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2467199f0ab2463fa17d4b8766d859a1)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.167799 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.230239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1093/2199] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:52.231289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.236542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.274868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409d45-d66f-4790-9371-5c31bf4b3715 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.282063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.283240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.283529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.283926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.284682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.293629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.401616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2467199f0ab2463fa17d4b8766d859a1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:52.411553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2467199f0ab2463fa17d4b8766d859a1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:52.451279 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1094/2200] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:52 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:52.452461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.458175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.467645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:52.525114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2467199f0ab2463fa17d4b8766d859a1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:52.525783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2467199f0ab2463fa17d4b8766d859a1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:52.553633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2467199f0ab2463fa17d4b8766d859a1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:52.564570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1107/2201] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:51 2022] DELETE /identity/v3/users/2467199f0ab2463fa17d4b8766d859a1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:52.565303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.567774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.590799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325d37-f9df-4004-a036-d8e424b58e81 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.682983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f9f3-4348-4487-bd6b-e28bba81391c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.690081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.690774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.691049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.691333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.691986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.692284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.692904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.693186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.693462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.693994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.694093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.696613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.777444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1108/2202] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:52 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:52.781660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.793936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f63a05-429e-48d3-abb4-3c51e56976d2 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.799020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.799800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.800085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.800359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.801016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.802618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.813999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1095/2203] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:52 2022] POST /identity/v3/projects => generated 385 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:52.815963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.816968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1109/2204] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:52.818110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:52.821018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:52.832540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bac54-c7a6-4c13-af9a-c8af0e09ef1f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.898575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.899292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.899576 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.901292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] PATH_INFO: `/v3/projects/6bf2c4b9eec94359a4a6f36df6725140/users/bf63a2edffaf43a9924ff69011e5b16d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.906245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06474c1-6bfd-47c7-a3fd-1c289cd7d047 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:52.912564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:52.913527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:52.913976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:52.915258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:52.916555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.922755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:52.923450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf2c4b9eec94359a4a6f36df6725140, user_id=bf63a2edffaf43a9924ff69011e5b16d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:52.926757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.000247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1110/2205] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:52 2022] PUT /identity/v3/projects/6bf2c4b9eec94359a4a6f36df6725140/users/bf63a2edffaf43a9924ff69011e5b16d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:53.004332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.033046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1096/2206] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:52 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:53.034204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.048084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457ef51-5225-41d9-a642-cfbe01fd6bbb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.142525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cef7-2ea5-4cb1-9649-bef2d1149afa admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.155314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.155929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.156518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.156518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.157107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.158785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.179479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1111/2207] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:53.184714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.186942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.187576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.187854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.188122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.188880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.190412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.208096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1f05-21f1-4fe1-919b-487c2bc2eeed admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.212404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1097/2208] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:53.229999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:53.229999 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.230720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.230720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.230720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.230720 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] PATH_INFO: `/v3/projects/6bf2c4b9eec94359a4a6f36df6725140/users/bf63a2edffaf43a9924ff69011e5b16d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.233647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf2c4b9eec94359a4a6f36df6725140, user_id=bf63a2edffaf43a9924ff69011e5b16d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.237028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15474e2e-2548-4f1e-95ae-ae66673ec750 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.243385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e708f-0c8c-439d-b606-8578d005558c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.251534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.252790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.253081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.253358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] PATH_INFO: `/v3/projects/391cee1dd734476cbed963ed22d0e174/users/69f4c2eff49747778fea6e1fec979899/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.260059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1112/2209] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:53 2022] PUT /identity/v3/projects/6bf2c4b9eec94359a4a6f36df6725140/users/bf63a2edffaf43a9924ff69011e5b16d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:53.273188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.273188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.276717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.305585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391cee1dd734476cbed963ed22d0e174, user_id=69f4c2eff49747778fea6e1fec979899, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.306300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.350026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] MFA Rules not processed for user `bf63a2edffaf43a9924ff69011e5b16d`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:53.351437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:53.432169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1098/2210] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:53 2022] PUT /identity/v3/projects/391cee1dd734476cbed963ed22d0e174/users/69f4c2eff49747778fea6e1fec979899/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:53.435987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.518910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1113/2211] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:53.520008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.525249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:53.562193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f85e45-c024-4d2a-9eb3-7095583fcaa0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.574926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.576689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.577019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.577575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.578382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.580415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.597998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1099/2212] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:53.599028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.602835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:53.642807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab999-75a2-4f6c-a880-4230ba5e4d0e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.651722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.652459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.652753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.653207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] PATH_INFO: `/v3/projects/eb25e78a0ec64cc786053d6fad462a65` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.656928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb25e78a0ec64cc786053d6fad462a65)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.663007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.716984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf457-332c-433e-86c5-fc0a85c4bb86 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.724494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:53.724494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:53.724494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:53.724494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:53.729013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:53.845337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb25e78a0ec64cc786053d6fad462a65', 'request_id': 'req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:53.845593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:53.847369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:53.853178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb25e78a0ec64cc786053d6fad462a65', 'request_id': 'req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:53.858274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1100/2213] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:53.859551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb25e78a0ec64cc786053d6fad462a65', 'request_id': 'req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:53.871544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:53.922383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1122f-9c50-4bd1-a522-8a5746e860e7 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:53.999743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] The token cache is being invalidate because project eb25e78a0ec64cc786053d6fad462a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:54.000059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:54.002007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-7bf5de26-10bc-4f8c-8428-9b2ffb92f853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:54.009351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1114/2214] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:53 2022] DELETE /identity/v3/projects/eb25e78a0ec64cc786053d6fad462a65 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:54.029273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf330db-ff96-4834-b312-61ba71c312bf None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.029558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf330db-ff96-4834-b312-61ba71c312bf None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.029821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf330db-ff96-4834-b312-61ba71c312bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.119483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.120953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.121296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.121630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] PATH_INFO: `/v3/projects/391cee1dd734476cbed963ed22d0e174/users/69f4c2eff49747778fea6e1fec979899/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.124081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391cee1dd734476cbed963ed22d0e174, user_id=69f4c2eff49747778fea6e1fec979899, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.126852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85f69-4b42-486a-8063-9e946ca4caf5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.136507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-faf330db-ff96-4834-b312-61ba71c312bf None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:54.139823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-faf330db-ff96-4834-b312-61ba71c312bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.146775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1101/2215] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:53 2022] PUT /identity/v3/projects/391cee1dd734476cbed963ed22d0e174/users/69f4c2eff49747778fea6e1fec979899/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:54.158109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934370-678f-4261-889b-fd41db427304 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.158421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934370-678f-4261-889b-fd41db427304 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.158661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934370-678f-4261-889b-fd41db427304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.222610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-0b934370-678f-4261-889b-fd41db427304 None None] MFA Rules not processed for user `69f4c2eff49747778fea6e1fec979899`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:54.224099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0b934370-678f-4261-889b-fd41db427304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.334502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1115/2216] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:54.337264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.337767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.337852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.371639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:54.373334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.398452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1116/2217] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:54.407190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.417747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56330cc-e044-417e-919b-8ca3a230d793 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.425335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.426449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.426979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.427497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.428402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:54.429972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.436345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.453982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1102/2218] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:54.459560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1117/2219] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:04:54.460185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934370-678f-4261-889b-fd41db427304 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.465505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.467435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.478560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934370-678f-4261-889b-fd41db427304 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.494491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.494905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.495299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.495564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.496273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.525319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.571507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bb40d-af67-46a7-9c4e-a93562a1b71a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.577174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.577820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.578081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.578353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.591681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.594000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da2c22-7099-4444-90a4-fea08676a91b service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.620058 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1118/2220] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:54.662020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1103/2221] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:54.662350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.662350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.662350 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.663048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.701700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] MFA Rules not processed for user `0fc9a7bfd2dc48a6ab96957b23b45eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:54.702968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.743477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ddc3-2edf-4270-80b1-b959e9a21afc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.751119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.751119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.751119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.751119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.751419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.752917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.806401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1119/2222] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:54.832735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.834166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:54.888403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1104/2223] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:54 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:04:54.892129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.914667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:54.915415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b26ad-7e6a-42e1-b006-f1a5c2a2c8ab admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.927680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.928512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.928935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.929369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.930361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.938258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cf5b3-2128-4132-a789-cb5f5388ab35 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.941559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.961722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.967539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.968067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.969549 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1105/2224] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:04:54.970836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.973286 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:54.984943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552621a-60d9-4314-85ff-9f7fe3e63108 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:54.991571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:54.995319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:54.995813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:54.996661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:54.997756 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:54.998240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:54.999681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:55.004611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000399-4279-46a8-8a6a-3e494ceec1b1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:55.017436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1120/2225] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:55.019763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1106/2226] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:55.021378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:55.027325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:55.037954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0ba1-47b3-4da4-9121-da24fa2e4f76 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:55.047671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:55.048655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:55.054890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:55.054890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] PATH_INFO: `/v3/projects/cd1ec3d61a0a4ca4a42ea566a5f8fb42/users/e679bb70e61d49e79969331f0023f6b1/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:55.071787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1ec3d61a0a4ca4a42ea566a5f8fb42, user_id=e679bb70e61d49e79969331f0023f6b1, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:55.074663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:55.209392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1121/2227] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:55 2022] PUT /identity/v3/projects/cd1ec3d61a0a4ca4a42ea566a5f8fb42/users/e679bb70e61d49e79969331f0023f6b1/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:55.219563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:55.220281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:55.220790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:55.259405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] MFA Rules not processed for user `e679bb70e61d49e79969331f0023f6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:55.260642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:55.346367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1107/2228] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:55.457449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:55.460129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:55.543841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052868-3cc8-470e-8459-74e8bb7f8cf5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:55.547880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:55.548594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:55.548875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:55.549149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:55.559367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:55.561286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394eb73-9a5a-4f62-978e-053eb9b3ea70 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:55.575693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1122/2229] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:55.606561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:55.693250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc26558-f8a6-420f-8d0c-bb9cb72b0eae None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:55.700330 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:55.700993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:55.701641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:55.701641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] PATH_INFO: `/v3/users/e679bb70e61d49e79969331f0023f6b1` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:55.704983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e679bb70e61d49e79969331f0023f6b1)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:55.705140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:56.004683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e679bb70e61d49e79969331f0023f6b1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.026953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e679bb70e61d49e79969331f0023f6b1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.152032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e679bb70e61d49e79969331f0023f6b1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.186036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e679bb70e61d49e79969331f0023f6b1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.186961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e679bb70e61d49e79969331f0023f6b1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.201837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1108/2230] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:55 2022] DELETE /identity/v3/users/e679bb70e61d49e79969331f0023f6b1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:56.206057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:56.206601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:56.207239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:56.242613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:56.244886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:56.344153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1123/2231] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:56.353430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:56.356522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:56.462848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c596198-432f-4280-9278-43aff9a85d1a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:56.471463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:56.472094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:56.472380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:56.472897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:56.496235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:56.497781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:56.499330 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:56.502352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:56.510762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1109/2232] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:56.519713 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3920c15-da00-41f2-b9ec-6cecc4e458fe None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:56.526981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:56.528059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:56.528565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:56.543232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] PATH_INFO: `/v3/users/44bcc4b6c3f248f1ae185de46881da74` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:56.543232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bcc4b6c3f248f1ae185de46881da74)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:56.543232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:56.621762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:56.623379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:56.636769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce07800-acef-4bac-91b1-3f2f4ab65d7f service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:56.641123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:56.641777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:56.642051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:56.642320 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] PATH_INFO: `/v3/users/c223a6d7705d433696b11c8f962cdcec` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:56.643474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c223a6d7705d433696b11c8f962cdcec)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:56.645495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:56.836899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bcc4b6c3f248f1ae185de46881da74'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.849393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bcc4b6c3f248f1ae185de46881da74'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.987941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bcc4b6c3f248f1ae185de46881da74'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:56.988939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bcc4b6c3f248f1ae185de46881da74'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.010684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c223a6d7705d433696b11c8f962cdcec'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.023950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bcc4b6c3f248f1ae185de46881da74'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.025861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c223a6d7705d433696b11c8f962cdcec'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.034842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1124/2233] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:56 2022] DELETE /identity/v3/users/44bcc4b6c3f248f1ae185de46881da74 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:57.036605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:57.038594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.107453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c223a6d7705d433696b11c8f962cdcec'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.126751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c223a6d7705d433696b11c8f962cdcec'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.127766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d0197c6e-568a-408e-89e7-4831ea24fa7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c223a6d7705d433696b11c8f962cdcec'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.139980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1110/2234] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:56 2022] DELETE /identity/v3/users/c223a6d7705d433696b11c8f962cdcec => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:57.139980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f925d-efc8-4d35-ab1a-2ccf373813a6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.139980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f925d-efc8-4d35-ab1a-2ccf373813a6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.139980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f925d-efc8-4d35-ab1a-2ccf373813a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.160813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-6b0f925d-efc8-4d35-ab1a-2ccf373813a6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:57.162072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6b0f925d-efc8-4d35-ab1a-2ccf373813a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.175368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c4c12-996a-4aae-9098-4664a2effe4a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:57.309935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:57.310884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.311305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.311732 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] PATH_INFO: `/v3/projects/cd1ec3d61a0a4ca4a42ea566a5f8fb42` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.313692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1ec3d61a0a4ca4a42ea566a5f8fb42)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:57.316714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:57.320299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1111/2235] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:57.321917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.322203 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.322474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.343309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:57.344530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.355380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1112/2236] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:57.356250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:57.360416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.425944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fbe90-0c44-4fbf-a40e-9a6f7c9b8215 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:57.430852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:57.431339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.431682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.432025 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.442513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:57.443992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:57.456048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1113/2237] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:57.457104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:57.466699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6e3e7-4b66-48b2-acdb-06d2ca581551 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:57.470666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:57.471450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.471745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.471866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.483525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:57.485967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c9a65-e11a-4c42-96e0-7c5740b46e96 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:57.498367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1114/2238] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:04:57.513944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1ec3d61a0a4ca4a42ea566a5f8fb42', 'request_id': 'req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.523121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1ec3d61a0a4ca4a42ea566a5f8fb42', 'request_id': 'req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.531346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1ec3d61a0a4ca4a42ea566a5f8fb42', 'request_id': 'req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.609191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] The token cache is being invalidate because project cd1ec3d61a0a4ca4a42ea566a5f8fb42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:57.610526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.613291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-64b9dcfa-3928-4df0-b787-bdb42e8d2fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:57.615707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1125/2239] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:57 2022] DELETE /identity/v3/projects/cd1ec3d61a0a4ca4a42ea566a5f8fb42 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:57.621813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.623141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.624066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.681516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:57.683251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.769855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1115/2240] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:04:57.779744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.780189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.780541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.814295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:57.815813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:57.837166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1126/2241] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:57.841412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:57.852710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231cd4e-4709-468b-ae3c-c2af77719220 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:57.857891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:57.858519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.858903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.859178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.860534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:57.860856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:57.862476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:57.881067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1116/2242] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:57.884865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:57.895000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb827-284e-4ace-b0f4-7eb05dc6a260 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:57.902315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:57.904778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:57.905323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:57.906805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:57.908044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:57.912631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:58.060136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1127/2243] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:57 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:58.069495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:58.079993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af460-8443-4152-a360-02149493ccd1 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:58.097422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:58.201738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:58.201738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:58.201738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:58.201738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:58.202170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:58.202170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:58.280585 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:58.434556 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1117/2244] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:58 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:58.438810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:58.448661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:58.456998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:58.467939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c0d-c51c-4126-af28-0b365cfdc190 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:58.484296 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:58.485748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:58.486029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:58.489181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:58.491369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:58.496166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:58.503253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52485b-5271-4821-a0f8-3cf320a1a375 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:58.526435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1128/2245] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:58.528400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:58.530044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:58.531005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:58.531454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:58.532131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] PATH_INFO: `/v3/projects/570f912759944302ac9cf70147f3c44e` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:58.533677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570f912759944302ac9cf70147f3c44e)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:58.536078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:58.537690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:58.568748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc745e4-f052-4944-bfd8-adbbb1f09cac admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:58.581165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:58.582415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:58.582936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:58.583499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] PATH_INFO: `/v3/projects/fe1e28643fe64e8f856ed6f67e2106bb` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:58.586841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1e28643fe64e8f856ed6f67e2106bb)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:58.589820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:58.722938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570f912759944302ac9cf70147f3c44e', 'request_id': 'req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.729223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570f912759944302ac9cf70147f3c44e', 'request_id': 'req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.771291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1e28643fe64e8f856ed6f67e2106bb', 'request_id': 'req-18fafad0-205a-448d-b3e1-09701df33f43'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.778873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1e28643fe64e8f856ed6f67e2106bb', 'request_id': 'req-18fafad0-205a-448d-b3e1-09701df33f43'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.784604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1e28643fe64e8f856ed6f67e2106bb', 'request_id': 'req-18fafad0-205a-448d-b3e1-09701df33f43'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.861283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570f912759944302ac9cf70147f3c44e', 'request_id': 'req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.875167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] The token cache is being invalidate because project 570f912759944302ac9cf70147f3c44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:58.875456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.876384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.877961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1118/2246] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:58 2022] DELETE /identity/v3/projects/570f912759944302ac9cf70147f3c44e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:04:58.878713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:58.880032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:58.946394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] The token cache is being invalidate because project fe1e28643fe64e8f856ed6f67e2106bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:04:58.947003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.947420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-18fafad0-205a-448d-b3e1-09701df33f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:58.952369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1129/2247] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:04:58 2022] DELETE /identity/v3/projects/fe1e28643fe64e8f856ed6f67e2106bb => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:58.953697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117af53-3a17-42f3-b6a3-ed7475092d1b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:58.953993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117af53-3a17-42f3-b6a3-ed7475092d1b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:58.954273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117af53-3a17-42f3-b6a3-ed7475092d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:58.973880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58fca-f560-4231-ba5c-1ae0c2fd84b0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:58.975802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f117af53-3a17-42f3-b6a3-ed7475092d1b None None] MFA Rules not processed for user `0fc9a7bfd2dc48a6ab96957b23b45eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:58.977936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f117af53-3a17-42f3-b6a3-ed7475092d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.038040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.038658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.039490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.039758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.040407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.042004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.056794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1130/2248] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:59.058448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.062270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.062382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1119/2249] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:04:59.062463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.062535 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.064471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.079836 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671b6f-d9c0-435b-b1e3-a73053e76c6d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:59.084710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.085342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.088441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.088560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:59.088675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] PATH_INFO: `/v3/users/69f4c2eff49747778fea6e1fec979899` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.088675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f4c2eff49747778fea6e1fec979899)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.088812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.090891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.102874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1131/2250] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:59.102874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.105219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.124669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1d70b-d5c6-446f-8d9d-bca9749f7890 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:59.129460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.130126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.130406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.130680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] PATH_INFO: `/v3/projects/e592cb42eb2946359ec2494685783c28/users/eb85b60eba0f4edeac7714077196208b/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.146602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e592cb42eb2946359ec2494685783c28, user_id=eb85b60eba0f4edeac7714077196208b, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.150327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66724e7-114f-4864-b6ac-4e8fdf2eab94 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.316977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1132/2251] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:04:59 2022] PUT /identity/v3/projects/e592cb42eb2946359ec2494685783c28/users/eb85b60eba0f4edeac7714077196208b/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:59.318826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3594-a965-422e-af95-9ffc44d054e6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.319414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3594-a965-422e-af95-9ffc44d054e6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.319981 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3594-a965-422e-af95-9ffc44d054e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.366939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-101e3594-a965-422e-af95-9ffc44d054e6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:59.366939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-101e3594-a965-422e-af95-9ffc44d054e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.371101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f4c2eff49747778fea6e1fec979899'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:59.399980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f4c2eff49747778fea6e1fec979899'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:59.432841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1133/2252] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:59.434310 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.434602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.434929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.469188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] MFA Rules not processed for user `eb85b60eba0f4edeac7714077196208b`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:04:59.470400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.542429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f4c2eff49747778fea6e1fec979899'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:59.561249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f4c2eff49747778fea6e1fec979899'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:59.563838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f4c2eff49747778fea6e1fec979899'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:04:59.569928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1134/2253] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:04:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:04:59.573885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.576035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1120/2254] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:04:59 2022] DELETE /identity/v3/users/69f4c2eff49747778fea6e1fec979899 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:04:59.581654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.583562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.590407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a19ae5-9803-4f1a-b824-3e545d695d25 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:59.657038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838510c-05e5-4bc3-8d88-34536680c5a0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:59.661071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.661726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.661996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.662267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.664900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.673570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.674401 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.674512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.674760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.675437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:04:59.675803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.678007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.697094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1135/2255] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:04:59.698239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.701320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:04:59.723812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084c99-28af-415c-b471-d26f7b2febde admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:04:59.729828 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:04:59.730448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:04:59.730744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:04:59.731206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:04:59.731860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.733888 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.751864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:59.752385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:04:59.753862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:04:59.770862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1121/2256] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:04:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:04:59.949863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1136/2257] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:04:59 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:04:59.951663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:04:59.976229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfb31-f574-4955-8308-8ff2ffb1527c service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.072091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.072091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.072091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.072091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.072566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.073968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.199983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1122/2258] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:04:59 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:00.204285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.215275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e04-3582-46d1-87a3-41ba4a8efb46 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.222946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.222946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.222946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.222946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.223333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.223805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.230488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.235659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.243472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1137/2259] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:00.244730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.256533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45309-5a40-46c1-b982-1b06e8c43eda admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.262097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.262716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.263033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.263307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.263961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.266662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ea11-9849-4d8e-8e0b-04a968dac2cb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.271380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.272014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.272294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.272587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] PATH_INFO: `/v3/projects/391cee1dd734476cbed963ed22d0e174` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.274503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] RBAC: Authorizing `identity:delete_project(project_id=391cee1dd734476cbed963ed22d0e174)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.276463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.277100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.290544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1138/2260] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:00.300790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.315057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323fac7-c0a6-49c8-ac1b-3c4b58be8bc4 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.322617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.323317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.323594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.323937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] PATH_INFO: `/v3/projects/ecb9e054d21e43db93473ca04e688c29/users/14caeeea3623495c87977ea71af4aad7/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.342924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb9e054d21e43db93473ca04e688c29, user_id=14caeeea3623495c87977ea71af4aad7, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.345847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f139f5-1047-4392-a9f1-54ca4b49b8f1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.485982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1139/2261] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:00 2022] PUT /identity/v3/projects/ecb9e054d21e43db93473ca04e688c29/users/14caeeea3623495c87977ea71af4aad7/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:00.495008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391cee1dd734476cbed963ed22d0e174', 'request_id': 'req-e2eaf578-c8b1-410e-953d-f3eeeeff867e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:00.496670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.496961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.497353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.502103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391cee1dd734476cbed963ed22d0e174', 'request_id': 'req-e2eaf578-c8b1-410e-953d-f3eeeeff867e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:00.534993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:00.534993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.588517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1140/2262] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:00.589492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.590791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.603780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391cee1dd734476cbed963ed22d0e174', 'request_id': 'req-e2eaf578-c8b1-410e-953d-f3eeeeff867e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:00.616228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] The token cache is being invalidate because project 391cee1dd734476cbed963ed22d0e174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:00.616609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:00.617476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:00.619174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1123/2263] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:00 2022] DELETE /identity/v3/projects/391cee1dd734476cbed963ed22d0e174 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:00.622580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.622580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.662314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009843-d3a3-49c9-b40c-ba714c9d5db0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.667376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.668135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.668489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.668856 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.670879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.701179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf578-c8b1-410e-953d-f3eeeeff867e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.705702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.706323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.706621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.706946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.708874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.727223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.728905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1b23b-1c92-4558-abee-b32a75e36c05 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.738690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1124/2264] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:00.739951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.740235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.740515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.744947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.746446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98e76-18a6-4021-9f04-acd91ec5b381 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.757561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1141/2265] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:00.765716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:00.767011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.776970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1125/2266] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:00.784746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.789540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.790022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.852448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:00.854003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:00.875982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.876946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1142/2267] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:00.889412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab000d-1572-4a83-9107-e753ea9eb567 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.904694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.905577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.906105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.906444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.907272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:00.907774 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.909577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:00.926022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1126/2268] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:00.929361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:00.946410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69981-ecb4-4ef5-8ea5-c55eca6e9869 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:00.953092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:00.953703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:00.953891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:00.954191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:00.955025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:00.973282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:01.140413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1143/2269] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:00 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:01.145051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:01.156804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec162b9-ed1e-4e00-9cc1-68aeb5675004 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:01.222405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:01.223362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.223812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.224224 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.224994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:01.227501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:01.381574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1127/2270] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:01 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:01.386474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:01.398983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97001c94-3ec1-4e60-b4f1-fd97d88c83b6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:01.404200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674145-4e08-462b-a039-e569093c110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:01.404833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674145-4e08-462b-a039-e569093c110e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.405128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674145-4e08-462b-a039-e569093c110e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.405400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674145-4e08-462b-a039-e569093c110e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.406049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674145-4e08-462b-a039-e569093c110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:01.407781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674145-4e08-462b-a039-e569093c110e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:01.419078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1144/2271] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:01.423039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:01.447341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d893af9-ec78-4eff-9087-5b82b961bcdb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:01.452474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:01.453312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.453595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.453863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.454510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:01.456191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66f46e-1c6d-418a-8443-fd4a6523e1a6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:01.467802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1128/2272] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:01.472158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674145-4e08-462b-a039-e569093c110e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:01.483398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674145-4e08-462b-a039-e569093c110e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:01.488055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:01.488708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.489167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.489449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] PATH_INFO: `/v3/projects/5d866012eaab44ef99ab78d209ee6a65/users/819100b20f4b43c0a7fa8b3ba3184a9d/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.506395 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d866012eaab44ef99ab78d209ee6a65, user_id=819100b20f4b43c0a7fa8b3ba3184a9d, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:01.519431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:01.599940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1145/2273] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:01 2022] PUT /identity/v3/projects/5d866012eaab44ef99ab78d209ee6a65/users/819100b20f4b43c0a7fa8b3ba3184a9d/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:01.613617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.614077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.614936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.647390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] MFA Rules not processed for user `819100b20f4b43c0a7fa8b3ba3184a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:01.650638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:01.751191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1129/2274] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:01.755488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:01.804758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:01.866465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da20618-ed1d-4887-8504-d7b22c777302 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:01.874656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:01.875633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:01.876101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:01.876544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:01.877336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:01.881315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.002067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1146/2275] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:01 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:05:02.004419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.016726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a92a2-91aa-4d0b-85f3-c916bf5f7fd3 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.076820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.077452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.077738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.078752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.079432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.081389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.175846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1130/2276] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:02 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:02.180905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.191651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba174ef-1870-457d-bf18-48c51b82e4df admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.202766 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.204242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.204242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.204470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.205832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.207746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.224626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1147/2277] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:02.228690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.241581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c13f7-7bb7-4cc5-bca8-e8d3e13035b0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.251044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.251958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.252533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.252994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] PATH_INFO: `/v3/projects/a511b1898f044338923554d210d372c8/users/ff1a8cd16aba494690d9920a7da62d4f/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.270433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a511b1898f044338923554d210d372c8, user_id=ff1a8cd16aba494690d9920a7da62d4f, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.273260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.401481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1131/2278] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:02 2022] PUT /identity/v3/projects/a511b1898f044338923554d210d372c8/users/ff1a8cd16aba494690d9920a7da62d4f/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:02.407770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.420946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00029-0b71-4c44-8cbe-c2ee55211dc8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.493098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.495203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.495648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.495927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.496586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.498213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498fbad-1c7d-42b9-8e9d-48b849a96862 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.511922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1148/2279] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:02.515987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.526327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa4f2-b0e5-4d04-a903-70474cde3fed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.531618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.532301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.532582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.532860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] PATH_INFO: `/v3/projects/a511b1898f044338923554d210d372c8/users/ff1a8cd16aba494690d9920a7da62d4f/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.535894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a511b1898f044338923554d210d372c8, user_id=ff1a8cd16aba494690d9920a7da62d4f, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.539264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.550281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1132/2280] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:02 2022] PUT /identity/v3/projects/a511b1898f044338923554d210d372c8/users/ff1a8cd16aba494690d9920a7da62d4f/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:02.560633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.560925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.561222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.590011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] MFA Rules not processed for user `ff1a8cd16aba494690d9920a7da62d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:02.591335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:02.661511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1149/2281] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:02.672900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:02.674633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:02.783834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:02.787434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7f6b-16d4-4030-9181-0d35d87f7147 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:02.796213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:02.796953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:02.797220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:02.797771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:02.814883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:02.816369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadc389-7388-4f76-bd84-dcf127d23e22 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:02.828590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1133/2282] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:03.406299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:04.307833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:04.385316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651ff04-c7d5-465b-9e2a-117cfb79cc0d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:04.392678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:04.393815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:04.394195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:04.394892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] PATH_INFO: `/v3/users/819100b20f4b43c0a7fa8b3ba3184a9d` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:04.396321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=819100b20f4b43c0a7fa8b3ba3184a9d)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:04.399043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:04.665478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819100b20f4b43c0a7fa8b3ba3184a9d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:04.675648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819100b20f4b43c0a7fa8b3ba3184a9d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:04.850117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819100b20f4b43c0a7fa8b3ba3184a9d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:04.852112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819100b20f4b43c0a7fa8b3ba3184a9d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:04.885100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:04.891248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819100b20f4b43c0a7fa8b3ba3184a9d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:04.903745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1150/2283] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:04 2022] DELETE /identity/v3/users/819100b20f4b43c0a7fa8b3ba3184a9d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:04.908895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:04.909892 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:04.910502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:04.944424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:04.966974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:05.178714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1134/2284] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:05.196370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:05.205091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:05.355822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7a95-b462-416e-a969-ed213adcf6bd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:05.359930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:05.360552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:05.360829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:05.361106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:05.374976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:05.376511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:05.397142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1151/2285] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:05.457151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:06.154973 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:06.156921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:06.182716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49331-1cde-4492-a08e-ddf91f435ced None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:06.207194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:06.207851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:06.208138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:06.208416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] PATH_INFO: `/v3/projects/5d866012eaab44ef99ab78d209ee6a65` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:06.217231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d866012eaab44ef99ab78d209ee6a65)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:06.219375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:06.377334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d866012eaab44ef99ab78d209ee6a65', 'request_id': 'req-2e944b2c-de70-4c54-bfab-859284246bfc'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.386782 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d866012eaab44ef99ab78d209ee6a65', 'request_id': 'req-2e944b2c-de70-4c54-bfab-859284246bfc'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.484186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:06.495005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d866012eaab44ef99ab78d209ee6a65', 'request_id': 'req-2e944b2c-de70-4c54-bfab-859284246bfc'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.509158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] The token cache is being invalidate because project 5d866012eaab44ef99ab78d209ee6a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:06.509451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.510107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.511829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1135/2286] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:06 2022] DELETE /identity/v3/projects/5d866012eaab44ef99ab78d209ee6a65 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:06.515941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:06.527113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0155acf-5b6b-4733-b16a-d3c5da2bf299 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:06.587059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:06.587693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:06.588004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:06.599118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] PATH_INFO: `/v3/users/ff1a8cd16aba494690d9920a7da62d4f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:06.599118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1a8cd16aba494690d9920a7da62d4f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:06.599118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:06.852541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1a8cd16aba494690d9920a7da62d4f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.860641 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1a8cd16aba494690d9920a7da62d4f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.981621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1a8cd16aba494690d9920a7da62d4f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:06.982967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1a8cd16aba494690d9920a7da62d4f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.007356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a9d13cd7-1b71-4262-91fa-1a5a37f781c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1a8cd16aba494690d9920a7da62d4f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.016232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1152/2287] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:06 2022] DELETE /identity/v3/users/ff1a8cd16aba494690d9920a7da62d4f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:07.101686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:07.259378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:07.260871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:07.289534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e944b2c-de70-4c54-bfab-859284246bfc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:07.363559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:07.364899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:07.365177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:07.366386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] PATH_INFO: `/v3/users/61bfe15af6cb4796ac2327cc410b796d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:07.367984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bfe15af6cb4796ac2327cc410b796d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:07.370096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:07.680853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bfe15af6cb4796ac2327cc410b796d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.690455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bfe15af6cb4796ac2327cc410b796d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.760200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bfe15af6cb4796ac2327cc410b796d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.787154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bfe15af6cb4796ac2327cc410b796d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.789205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bfe15af6cb4796ac2327cc410b796d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:07.805112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1136/2288] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:07 2022] DELETE /identity/v3/users/61bfe15af6cb4796ac2327cc410b796d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:07.806851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:07.807287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:07.807409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:07.828388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:07.829874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:07.894427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:07.895296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:07.943173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1153/2289] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:07.949935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:07.951922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.045489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8af8-f5d9-4b37-bb4f-668a77e3610e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.053918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.055423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.055893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.056386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] PATH_INFO: `/v3/projects/a511b1898f044338923554d210d372c8` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.057518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af153a-b01b-4b18-bbfe-bc807cdd8677 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.058010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a511b1898f044338923554d210d372c8)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.061270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.061463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.062881 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.063550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.063968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.078145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.079780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.092365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1154/2290] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:08.093548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.095601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.110708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082af0f-9caa-46dc-b1d5-a7812df38573 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.116410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.117087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.118349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.118349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] PATH_INFO: `/v3/users/eb85b60eba0f4edeac7714077196208b` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.119037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb85b60eba0f4edeac7714077196208b)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.120999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.240547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a511b1898f044338923554d210d372c8', 'request_id': 'req-a6c2388f-986c-43de-b6ca-cd4aabc7c541'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.246332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a511b1898f044338923554d210d372c8', 'request_id': 'req-a6c2388f-986c-43de-b6ca-cd4aabc7c541'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.259772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:08.341155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a511b1898f044338923554d210d372c8', 'request_id': 'req-a6c2388f-986c-43de-b6ca-cd4aabc7c541'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.366255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] The token cache is being invalidate because project a511b1898f044338923554d210d372c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:08.366550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.368147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a6c2388f-986c-43de-b6ca-cd4aabc7c541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.370655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1137/2291] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:07 2022] DELETE /identity/v3/projects/a511b1898f044338923554d210d372c8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:08.375374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc985c4-e395-4afa-b544-7e08c24a507d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.376000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc985c4-e395-4afa-b544-7e08c24a507d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.376482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc985c4-e395-4afa-b544-7e08c24a507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.380107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb85b60eba0f4edeac7714077196208b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.396185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb85b60eba0f4edeac7714077196208b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.410643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-fbc985c4-e395-4afa-b544-7e08c24a507d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:08.413686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fbc985c4-e395-4afa-b544-7e08c24a507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.472138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb85b60eba0f4edeac7714077196208b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.472842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb85b60eba0f4edeac7714077196208b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.492294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9c4058b3-0d64-448a-8c87-25b708d11f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb85b60eba0f4edeac7714077196208b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:08.508119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1155/2292] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:08 2022] DELETE /identity/v3/users/eb85b60eba0f4edeac7714077196208b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:08.512633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.512802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.513051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.528848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1138/2293] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:08.538057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.538351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.539033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.566500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:08.566500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.578833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:08.580049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.703636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1156/2294] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:08.711507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1139/2295] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:08.713349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.732012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.733445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.739321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8701c1-3fb8-499c-923c-4d6d3985518b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.757489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.758684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.760511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.761063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.762450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:08.770393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.770393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.802757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1157/2296] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:08.811441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.821739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd1a4-73c3-4ecb-aa09-069b1b92f2c9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.827224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.828119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.828579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.828854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.829654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.831791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.838984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab4e0-f1cb-4d40-869f-69ef1f9aa70f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.845299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.846820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.847301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.847754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.866192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.868293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.883076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1140/2297] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:05:08.888465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.888465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:08.909861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320d0d1-555b-4ba9-a87c-766e9486f4d7 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:08.919983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:08.920970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:08.923038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:08.923038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] PATH_INFO: `/v3/projects/41593d1ed60d4aa5abfa4cc04034976d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:08.924178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41593d1ed60d4aa5abfa4cc04034976d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:08.926281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:08.962680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1158/2298] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:08 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:08.963947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:08.981167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:09.092750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d368d8-56fe-443f-be5d-311f0cd176e3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.105127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.106002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.106753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.107457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.108314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.110650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:09.139695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41593d1ed60d4aa5abfa4cc04034976d', 'request_id': 'req-2bfa6fce-7e67-4810-85e4-f25849df6285'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.146360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41593d1ed60d4aa5abfa4cc04034976d', 'request_id': 'req-2bfa6fce-7e67-4810-85e4-f25849df6285'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.244765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1159/2299] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:08 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:09.261344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41593d1ed60d4aa5abfa4cc04034976d', 'request_id': 'req-2bfa6fce-7e67-4810-85e4-f25849df6285'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.264949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:09.276903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1248fae-8fb0-497c-b48f-ceafb57ce166 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.278461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] The token cache is being invalidate because project 41593d1ed60d4aa5abfa4cc04034976d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:09.279013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.279985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.281726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1141/2300] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:08 2022] DELETE /identity/v3/projects/41593d1ed60d4aa5abfa4cc04034976d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:09.290407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:09.291004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:09.372737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.373693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.374029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.374307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.375039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.376880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:09.392352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1160/2301] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:09.396526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:09.398476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:09.404469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6fce-7e67-4810-85e4-f25849df6285 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.411749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.412499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.412848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.413232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] PATH_INFO: `/v3/users/bf63a2edffaf43a9924ff69011e5b16d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.415914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf63a2edffaf43a9924ff69011e5b16d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.416307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ae1b-7fea-4646-8f8a-be4b2a3c0a96 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.418060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:09.424088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.425861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.426144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.426565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.427330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.432916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:09.449584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1161/2302] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:05:09.452145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:09.467737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7dab-e4c2-4c3d-bc4b-0f5fb268a359 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.475696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.477261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.477604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.478696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] PATH_INFO: `/v3/projects/9704ab3ae99843b59a635387844c55d0/users/a680c231ac484723b28dde70c867cdaf/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.501849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9704ab3ae99843b59a635387844c55d0, user_id=a680c231ac484723b28dde70c867cdaf, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.503550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c0c7c-a7cc-4cda-aedc-0f4bf10ca1a9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:09.619338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1162/2303] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:09 2022] PUT /identity/v3/projects/9704ab3ae99843b59a635387844c55d0/users/a680c231ac484723b28dde70c867cdaf/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:09.630913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397337e2-c444-4218-8827-73478eed90a6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.631351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397337e2-c444-4218-8827-73478eed90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.631692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397337e2-c444-4218-8827-73478eed90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.655058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf63a2edffaf43a9924ff69011e5b16d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.665528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf63a2edffaf43a9924ff69011e5b16d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.682370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-397337e2-c444-4218-8827-73478eed90a6 None None] MFA Rules not processed for user `a680c231ac484723b28dde70c867cdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:09.683091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-397337e2-c444-4218-8827-73478eed90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:09.735288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf63a2edffaf43a9924ff69011e5b16d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.772433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf63a2edffaf43a9924ff69011e5b16d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.774573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf63a2edffaf43a9924ff69011e5b16d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:09.775221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1163/2304] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:09.779491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397337e2-c444-4218-8827-73478eed90a6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:09.792328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1142/2305] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:09 2022] DELETE /identity/v3/users/bf63a2edffaf43a9924ff69011e5b16d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:09.892387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397337e2-c444-4218-8827-73478eed90a6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:09.992386 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:09.993176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:09.997976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:09.997976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:09.997976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:09.997976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.049522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:10.123548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1164/2306] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:10.127017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.128962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.152751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9346f-94c6-4f28-9f5b-30ae971e6121 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.204631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.206978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.257157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.258499 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.260484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.260880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.261945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.264277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dc0da-a5f3-4cc2-be5b-d3a4427c2dee admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.314143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2699a-663f-41c2-abd4-3285afaa7235 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.322165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.323212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.323579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.323919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] PATH_INFO: `/v3/projects/e592cb42eb2946359ec2494685783c28` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.328309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e592cb42eb2946359ec2494685783c28)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.330248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.352225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1143/2307] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:10 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:10.352225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.352225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.352225 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.407105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] MFA Rules not processed for user `14caeeea3623495c87977ea71af4aad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:10.408280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.479950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1144/2308] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:10.480898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.493659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449f7a-acc6-4917-a2ac-c5f6dc4a01d0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.498163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.498775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.499216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.499602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.500129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.501723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.512107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1145/2309] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:10.512107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.512107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.520362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e592cb42eb2946359ec2494685783c28', 'request_id': 'req-c479a6e8-a7da-40de-851d-bb72b59dbff8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:10.528717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab884f2f-ba6e-47de-a818-1be5d357de06 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.543438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e592cb42eb2946359ec2494685783c28', 'request_id': 'req-c479a6e8-a7da-40de-851d-bb72b59dbff8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:10.557324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e592cb42eb2946359ec2494685783c28', 'request_id': 'req-c479a6e8-a7da-40de-851d-bb72b59dbff8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:10.619636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.620383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.620790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.621157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.622077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.625035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0eb2-b7cb-421f-8ea1-7e42bf1520d6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.676117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] The token cache is being invalidate because project e592cb42eb2946359ec2494685783c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:10.676892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:10.678066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:10.681573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1165/2310] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:10 2022] DELETE /identity/v3/projects/e592cb42eb2946359ec2494685783c28 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:10.683737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.687442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.706537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a6e8-a7da-40de-851d-bb72b59dbff8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.720909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.721851 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.722907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.723270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.723999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.725685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.809622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1166/2311] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:10.809622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.809622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.809622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ec146-3ba5-40cb-a18a-b0941e877402 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.810203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.810203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.810203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.810203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] PATH_INFO: `/v3/projects/6bf2c4b9eec94359a4a6f36df6725140` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.810636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf2c4b9eec94359a4a6f36df6725140)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.810636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:10.862593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1146/2312] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:10 2022] POST /identity/v3/projects => generated 383 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:10.891002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.891002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.891002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.891002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:10.891002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:10.953126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1147/2313] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:10.953994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:10.968143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf6f29-e98b-4d7c-9c66-181bc833d16f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:10.972996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:10.973674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:10.973952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:10.974218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] PATH_INFO: `/v3/projects/35cca3fc09be4633b2e81217cee6881a/users/af1d095cace840b6ae9aa77db2418171/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:10.993832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cca3fc09be4633b2e81217cee6881a, user_id=af1d095cace840b6ae9aa77db2418171, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:10.997020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.135749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:11.268770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1148/2314] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:10 2022] PUT /identity/v3/projects/35cca3fc09be4633b2e81217cee6881a/users/af1d095cace840b6ae9aa77db2418171/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:11.271869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.271869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.282261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf2c4b9eec94359a4a6f36df6725140', 'request_id': 'req-ee1fa214-69e8-48d3-8d1c-22f055111c6b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:11.292046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf2c4b9eec94359a4a6f36df6725140', 'request_id': 'req-ee1fa214-69e8-48d3-8d1c-22f055111c6b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:11.299725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf2c4b9eec94359a4a6f36df6725140', 'request_id': 'req-ee1fa214-69e8-48d3-8d1c-22f055111c6b'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:11.343453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13f71-dee7-4411-a0dc-b64e4b30057a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:11.385724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] The token cache is being invalidate because project 6bf2c4b9eec94359a4a6f36df6725140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:11.386772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:11.387693 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ee1fa214-69e8-48d3-8d1c-22f055111c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:11.395257 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1167/2315] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:10 2022] DELETE /identity/v3/projects/6bf2c4b9eec94359a4a6f36df6725140 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:11.396922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bbd-5cc9-4373-9257-6cda65192041 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.397385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bbd-5cc9-4373-9257-6cda65192041 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.397824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bbd-5cc9-4373-9257-6cda65192041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.417417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:11.418038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.418315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.418605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.419623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:11.421590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.424378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3ac54bbd-5cc9-4373-9257-6cda65192041 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:11.429822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3ac54bbd-5cc9-4373-9257-6cda65192041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.448749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1168/2316] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:11.450046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbae3d-12f6-4e1b-a3e9-eebcbf59038a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.450583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbae3d-12f6-4e1b-a3e9-eebcbf59038a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.450894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbae3d-12f6-4e1b-a3e9-eebcbf59038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.481922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0dfbae3d-12f6-4e1b-a3e9-eebcbf59038a None None] MFA Rules not processed for user `af1d095cace840b6ae9aa77db2418171`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:11.483186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0dfbae3d-12f6-4e1b-a3e9-eebcbf59038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.552141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1169/2317] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:11.553467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.553756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.554087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.566288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1149/2318] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:11.570080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.579469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fff04-9a57-461e-9676-f71f9cda5159 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:11.581358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:11.582633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.584760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:11.587729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.588112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.588431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.589165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:11.589531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:11.592748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1170/2319] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:11.593916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.595743 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.604583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.625758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1150/2320] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:11.625758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.631699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5df63-e53d-42bf-845a-f936a1263996 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:11.631813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.642524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:11.643280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.647144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.647144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.647144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:11.651177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.657878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9100d-6434-4a0d-b516-3a2ca4822ed6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:11.675509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:11.676363 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.676648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.676918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.677558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:11.679313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3bdd7-bf24-44a3-91e4-d1ac99f229b2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.699015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1151/2321] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:11.699015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.699015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.699015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.751105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:11.752840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:11.763751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1152/2322] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:11.764550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.774146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ae4e2-634e-48b9-b31c-8540b1590f2e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:11.779905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:11.779905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:11.780269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:11.780269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:11.780862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:11.783629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:11.857436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1171/2323] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:11.858282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.911863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1153/2324] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:11 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:11.916441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:11.962464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb209e-b399-4446-bd12-e02231da12d4 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.040501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505540-ed2c-47b2-bbdd-4ebf4b204058 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.046525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.047887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.048269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.048543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.049201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:12.049321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.049520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.049985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.050262 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.050539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] PATH_INFO: `/v3/projects/816ee1e1aba54d30971685b18ff7b3e0/users/86c509ad478b4897bb1a37e43f2e09f7/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.051124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.078157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1154/2325] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:12.079441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.083937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816ee1e1aba54d30971685b18ff7b3e0, user_id=86c509ad478b4897bb1a37e43f2e09f7, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.087271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.097784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4871-b5c5-4113-9d10-6d27bb93b7ed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.104716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.105331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.105614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.105884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.106517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.108468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.268457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1155/2326] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:12 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:12.269179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.280192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1172/2327] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:11 2022] PUT /identity/v3/projects/816ee1e1aba54d30971685b18ff7b3e0/users/86c509ad478b4897bb1a37e43f2e09f7/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:12.281502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.287458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f0963-4f30-4bb2-8501-e2e48a10f241 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.364821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.365540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.365823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.366093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.367043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.369908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.371756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bc274-8464-4ef3-8c7e-249edc516ba3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.377816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.378406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.378817 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.379680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.380071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.384891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.479625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1156/2328] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:12 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:12.480656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.490843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92869e7-bc73-4b80-892e-26f09895b6ed admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.496528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.497118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.497397 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.497671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.498314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.500000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.513575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1157/2329] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:12.513575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.521628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877703f3-62c2-4b41-84f1-110114a2cdf6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.526617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.527228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.527506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.527777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.528403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.529963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.540966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1158/2330] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:12.541776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.559023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e49a-feb0-4a21-9886-ef09ebc043d2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.564570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1173/2331] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:12 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:12.565397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.575958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.576585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.576890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.577310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.578011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.579673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.594399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1159/2332] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:12.594399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.605744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed7e6-ebfd-40d5-86d3-e8806fbf6bf2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.660140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d65a4-ed7a-44e1-b5d2-0ed7544e9ac0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.666763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.667639 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.667931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.668190 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] PATH_INFO: `/v3/projects/d2235fb88c89460fbdf898b21ccab03c/users/aa6fe8912a614a6ab404e33a44300a6a/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.671335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.672311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.672448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.672737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] PATH_INFO: `/v3/projects/816ee1e1aba54d30971685b18ff7b3e0/users/86c509ad478b4897bb1a37e43f2e09f7/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.674858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=816ee1e1aba54d30971685b18ff7b3e0, user_id=86c509ad478b4897bb1a37e43f2e09f7, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.677793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.684992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2235fb88c89460fbdf898b21ccab03c, user_id=aa6fe8912a614a6ab404e33a44300a6a, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.687754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.694771 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1160/2333] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:12 2022] PUT /identity/v3/projects/816ee1e1aba54d30971685b18ff7b3e0/users/86c509ad478b4897bb1a37e43f2e09f7/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:12.696344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.821791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1174/2334] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:12 2022] PUT /identity/v3/projects/d2235fb88c89460fbdf898b21ccab03c/users/aa6fe8912a614a6ab404e33a44300a6a/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:12.822673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:12.825740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157945-1a79-466b-937c-7c79287a76ec admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.938563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b77e1-68e1-4adb-a855-d4a460720bac admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:12.947539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.949812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.950099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.951530 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.954377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.972534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.972639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:12.972639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:12.972639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:12.972639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:12.973430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:12.973430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:12.984419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1175/2335] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:12.985357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.005687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12b189-4f06-497d-b1ea-14d11572a565 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.029447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.030778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.031623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.031906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.032635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.035391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.052901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1176/2336] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:13.052901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.063970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d0ff8-a6a7-423e-9c23-f09eb7c4200f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.073038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.073038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.073038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.073038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] PATH_INFO: `/v3/projects/edc32ff8ca8d41f68a7ab107a7f2de7d/users/911f8cad768345c4861cd17cba7ce9a5/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.094919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc32ff8ca8d41f68a7ab107a7f2de7d, user_id=911f8cad768345c4861cd17cba7ce9a5, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.098085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.192460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1161/2337] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:12 2022] POST /identity/v3/users => generated 286 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:13.192460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.202132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096819d-5f20-4189-85c9-4ca6938c780a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.207584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.208360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.208845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.209093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] PATH_INFO: `/v3/projects/d2235fb88c89460fbdf898b21ccab03c/users/aa6fe8912a614a6ab404e33a44300a6a/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.218835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2235fb88c89460fbdf898b21ccab03c, user_id=aa6fe8912a614a6ab404e33a44300a6a, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.224927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03352de-aea7-4ffb-87a8-17f883423790 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.234837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1177/2338] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:13 2022] PUT /identity/v3/projects/edc32ff8ca8d41f68a7ab107a7f2de7d/users/911f8cad768345c4861cd17cba7ce9a5/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:13.235795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.253790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1162/2339] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:13 2022] PUT /identity/v3/projects/d2235fb88c89460fbdf898b21ccab03c/users/aa6fe8912a614a6ab404e33a44300a6a/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:13.253790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b69f2-a43c-41fd-99a5-4a4f38ad2075 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.253790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b69f2-a43c-41fd-99a5-4a4f38ad2075 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.253790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b69f2-a43c-41fd-99a5-4a4f38ad2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.284026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-bd6b69f2-a43c-41fd-99a5-4a4f38ad2075 None None] MFA Rules not processed for user `911f8cad768345c4861cd17cba7ce9a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:13.285292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bd6b69f2-a43c-41fd-99a5-4a4f38ad2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.353373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c826-1ffc-45d6-ad40-8652c20d3683 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.377477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1163/2340] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:13.379219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.379522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.379784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.412660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] MFA Rules not processed for user `aa6fe8912a614a6ab404e33a44300a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:13.414834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.423389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.424060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.424342 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.424618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.425756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.427231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.441616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1178/2341] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:13.441616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.444238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.530430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1164/2342] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:13.531422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.543389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca79b0-d1e6-4cfe-9ee5-f464fec36849 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.549021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.549652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.549938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.550410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.551125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.553426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.556816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c40b72-464d-4198-877e-df2ce241f678 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.563039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.563916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.564410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.564906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.566673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1165/2343] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:13.567575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.569375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.577934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.581656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.592059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56869789-d508-4690-b077-934ae9699bdc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.594571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1179/2344] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:13.595245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.598542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.599301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.599688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.600077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.604019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.608744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd05e-4b89-4102-8d3a-9fb2946ec5d0 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:13.627496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:13.627496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.627496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.627496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] PATH_INFO: `/v3/projects/a22dc4b84c264c708aa976a7ef06113d/users/9e9d73e445d24516a0a85bf897203564/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.645137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22dc4b84c264c708aa976a7ef06113d, user_id=9e9d73e445d24516a0a85bf897203564, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.651134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.692273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:13.694205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa29bb-9853-4425-b659-cc31e6123614 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:13.706440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1166/2345] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:13.802415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1180/2346] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:13 2022] PUT /identity/v3/projects/a22dc4b84c264c708aa976a7ef06113d/users/9e9d73e445d24516a0a85bf897203564/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:13.803448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:13.803693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:13.803987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:13.825157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:13.826651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.900418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1167/2347] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:13.911085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:13.912842 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:13.995956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ac6a-0bfe-4102-bc5a-f825a70215e5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:14.002982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:14.003786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:14.004738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:14.005087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:14.018182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:14.020145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169a820-a03f-4e5f-92a1-bb4a37e2981e service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:14.033001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1181/2348] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:14.375931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:14.810472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:16.282467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:16.303940 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:16.377324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:16.377905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:16.378012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:16.405111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb212c44-7fd0-4401-8c97-1ba02ba8e5e2 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:16.409890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:16.411151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:16.411678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:16.412151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:16.450067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] MFA Rules not processed for user `9e9d73e445d24516a0a85bf897203564`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:16.462288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:16.513474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:16.515162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:16.544978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1168/2349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:16.589985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1182/2350] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:16.602446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:16.615479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ae43b-595c-4608-97bd-5e3422e3a8fe service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:16.625530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:16.626543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:16.627058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:16.627553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:16.649425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:16.651277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c8a8-c502-4e03-9c5a-6f8f8645908d service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:16.683304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1169/2351] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:16.737989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:18.258113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:18.265845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:18.282686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15a0fa-be68-475d-a16d-07884a828d5c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:18.292484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:18.293504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:18.293993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:18.294463 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] PATH_INFO: `/v3/users/840fb4e4d3b8420791a84a0aaf2127ab` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:18.295900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840fb4e4d3b8420791a84a0aaf2127ab)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:18.298674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:18.608095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520399-b607-489b-983a-f5183d490794 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:18.608660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520399-b607-489b-983a-f5183d490794 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:18.608660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520399-b607-489b-983a-f5183d490794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:18.629995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-26520399-b607-489b-983a-f5183d490794 None None] MFA Rules not processed for user `9e9d73e445d24516a0a85bf897203564`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:18.631622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26520399-b607-489b-983a-f5183d490794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:18.637064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840fb4e4d3b8420791a84a0aaf2127ab'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:18.654080 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840fb4e4d3b8420791a84a0aaf2127ab'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:18.660091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1170/2352] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:18.787025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840fb4e4d3b8420791a84a0aaf2127ab'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:18.787700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840fb4e4d3b8420791a84a0aaf2127ab'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:18.806884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520399-b607-489b-983a-f5183d490794 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:18.807041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840fb4e4d3b8420791a84a0aaf2127ab'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:18.817918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1183/2353] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:18 2022] DELETE /identity/v3/users/840fb4e4d3b8420791a84a0aaf2127ab => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:18.824909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520399-b607-489b-983a-f5183d490794 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:18.896265 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:18.900239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:18.900977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:18.901421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:18.904064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:19.013553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:19.015051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:19.026624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1171/2354] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:05:19.611113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:19.612448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:19.735379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d26cb-3bde-4295-974d-3499f50ee0c7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:19.743913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:19.745621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:19.746394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:19.746910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] PATH_INFO: `/v3/projects/74887493d79f409290b7433c92f2d9a2` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:19.749472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=74887493d79f409290b7433c92f2d9a2)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:19.755043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:20.048484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74887493d79f409290b7433c92f2d9a2', 'request_id': 'req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.075945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74887493d79f409290b7433c92f2d9a2', 'request_id': 'req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.091488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74887493d79f409290b7433c92f2d9a2', 'request_id': 'req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.182422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] The token cache is being invalidate because project 74887493d79f409290b7433c92f2d9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:20.184397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.184397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.190921 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1184/2355] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:19 2022] DELETE /identity/v3/projects/74887493d79f409290b7433c92f2d9a2 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:20.195046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:20.218247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b5642-81ab-4c42-b76b-b743b2fdd239 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:20.354501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:20.361593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:20.361593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:20.361593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] PATH_INFO: `/v3/users/aaf3a795cd124727a93424fd07358ccd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:20.361593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf3a795cd124727a93424fd07358ccd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:20.374075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:20.660151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf3a795cd124727a93424fd07358ccd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.669253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf3a795cd124727a93424fd07358ccd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.689620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:20.786547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf3a795cd124727a93424fd07358ccd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.820182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf3a795cd124727a93424fd07358ccd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.820182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3a973626-8349-4a96-821a-1cfaa86e442a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf3a795cd124727a93424fd07358ccd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:20.831148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1172/2356] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:20 2022] DELETE /identity/v3/users/aaf3a795cd124727a93424fd07358ccd => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:20.935346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:21.492426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:21.494059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:21.521613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3e11b-4d04-4bc6-b0bf-23c16f723fcd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:21.658446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:21.659481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:21.660634 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:21.661652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] PATH_INFO: `/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:21.663403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6079926d9b4d19a4d22f4bb5f6690e)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:21.665853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:21.889904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6079926d9b4d19a4d22f4bb5f6690e', 'request_id': 'req-22a24951-7bb3-4291-a6de-f579eea189c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:21.901253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6079926d9b4d19a4d22f4bb5f6690e', 'request_id': 'req-22a24951-7bb3-4291-a6de-f579eea189c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:21.909476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6079926d9b4d19a4d22f4bb5f6690e', 'request_id': 'req-22a24951-7bb3-4291-a6de-f579eea189c6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:22.018708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] The token cache is being invalidate because project 2c6079926d9b4d19a4d22f4bb5f6690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:22.018708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:22.020436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-22a24951-7bb3-4291-a6de-f579eea189c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:22.022407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1185/2357] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:21 2022] DELETE /identity/v3/projects/2c6079926d9b4d19a4d22f4bb5f6690e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:22.029287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fbc-6eeb-448b-9598-baa5d7a3e403 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.030886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fbc-6eeb-448b-9598-baa5d7a3e403 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.031444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fbc-6eeb-448b-9598-baa5d7a3e403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.085256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2cf45fbc-6eeb-448b-9598-baa5d7a3e403 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:22.087660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2cf45fbc-6eeb-448b-9598-baa5d7a3e403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:22.112219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.112501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.114173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.209787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] MFA Rules not processed for user `86c509ad478b4897bb1a37e43f2e09f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:22.212353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:22.271608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1173/2358] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:22.274447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.274770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.275038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.298902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:22.300245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:22.314475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1174/2359] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:22.315388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:22.332873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43b6a6-42f5-4970-a2e4-402e6635dcb1 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:22.353171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:22.354486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.355969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.356757 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.359848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:22.360509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:22.367208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:22.398502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1186/2361] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:22.400673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:22.400809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1175/2361] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:22.412277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:22.415923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:22.418550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850bf08-130b-47d1-b0fe-91c53b9cb76b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:22.436660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:22.438452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.438941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.439506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.440327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:22.443727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:22.588940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1187/2362] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:22 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:22.590047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:22.639695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8bc-286a-403d-b27b-7d228f74fcdc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:22.785210 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c145-25c5-428d-9703-08490361f1f7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:22.793459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:22.800240 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:22.800880 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.801162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.801433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.807889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:22.811749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:22.812269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:22.813431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:22.814289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:22.818388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:22.967352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:22.967819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:22.999021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1188/2363] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:22 2022] POST /identity/v3/users => generated 288 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:23.000308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:23.021941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1176/2364] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:23.027277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1c05-e2fc-40a8-b38d-87a24ae6f03c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:23.042676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:23.043227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.043658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.044189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.044848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:23.046763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:23.077889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1189/2365] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:23.080136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:23.095176 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028b86-4c27-46f8-a63a-c6a725f1dcd0 service glance] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:23.100343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:23.101751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.102220 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.102957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.103777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:23.105683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90cc19-fbdf-4cf8-88cc-4ccafc2f63ea admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:23.128053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1177/2366] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:23.132093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:23.154848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7e65-18f1-4c3e-907a-7f71a214c83f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:23.167314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:23.168076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.168482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.168955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] PATH_INFO: `/v3/projects/54efbba9173b487c8275c191e50aad70/users/06a5e25e11a0499581f0a7940231a57f/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.217734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54efbba9173b487c8275c191e50aad70, user_id=06a5e25e11a0499581f0a7940231a57f, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:23.220820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c33a2-3cb9-4d7b-a4e4-b9f7c56745c7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:23.329554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1190/2367] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:23 2022] PUT /identity/v3/projects/54efbba9173b487c8275c191e50aad70/users/06a5e25e11a0499581f0a7940231a57f/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:23.340712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.341735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.342015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.382938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] MFA Rules not processed for user `06a5e25e11a0499581f0a7940231a57f`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:23.384347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:23.429581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4447-633c-476c-aed8-54087742e334 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.430425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4447-633c-476c-aed8-54087742e334 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.430836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4447-633c-476c-aed8-54087742e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.478418 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-958b4447-633c-476c-aed8-54087742e334 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:23.485831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-958b4447-633c-476c-aed8-54087742e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:23.551077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1178/2368] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:23.571994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:23.635918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1191/2369] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:05:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:23.687118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d185-ee97-4781-b430-a981f42307bc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:23.691957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:23.693226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.693721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.694164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.707477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:23.709388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:23.710120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4447-633c-476c-aed8-54087742e334 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:23.711722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-958b4447-633c-476c-aed8-54087742e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:23.724659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1179/2370] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:05:23.825054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4447-633c-476c-aed8-54087742e334 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:23.831796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:23.832474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:23.832794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:23.833090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:23.843388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:23.845167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce358f4-7db2-4e24-8530-0a3042c83412 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:23.856228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1192/2371] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:05:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:05:24.266486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:24.541047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:24.748396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:24.749897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:24.931312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e817b4-cc40-4988-a2f9-a7f7ae3054b3 service glance] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:24.939303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:24.940222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:24.940598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:24.941173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] PATH_INFO: `/v3/users/a680c231ac484723b28dde70c867cdaf` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:24.945179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a680c231ac484723b28dde70c867cdaf)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:24.947537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:25.373013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a680c231ac484723b28dde70c867cdaf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:25.402971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a680c231ac484723b28dde70c867cdaf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:25.530899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a680c231ac484723b28dde70c867cdaf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:25.568390 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a680c231ac484723b28dde70c867cdaf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:25.569583 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a680c231ac484723b28dde70c867cdaf'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:25.595745 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1180/2372] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:24 2022] DELETE /identity/v3/users/a680c231ac484723b28dde70c867cdaf => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:25.604030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:25.604561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:25.604771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:25.644798 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:25.649570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:25.748485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1193/2373] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:25.759374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:25.761229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:25.888297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637ae2-7ce3-4f2c-8c34-2a457d906335 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:25.902352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:25.903184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:25.906975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:25.907332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:25.957021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:25.958558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:25.995275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1181/2374] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:26.501405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:26.650547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:26.843938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:26.853664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:26.884631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430b00-dc4e-462b-ac34-2ff94a6e980d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:26.900132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:26.900795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:26.901076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:26.901353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] PATH_INFO: `/v3/projects/9704ab3ae99843b59a635387844c55d0` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:26.904663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9704ab3ae99843b59a635387844c55d0)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:26.923194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:27.248546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9704ab3ae99843b59a635387844c55d0', 'request_id': 'req-eb2006f1-e866-4da4-9ae3-35f1767bf864'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.259840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9704ab3ae99843b59a635387844c55d0', 'request_id': 'req-eb2006f1-e866-4da4-9ae3-35f1767bf864'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.279577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9704ab3ae99843b59a635387844c55d0', 'request_id': 'req-eb2006f1-e866-4da4-9ae3-35f1767bf864'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.394835 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] The token cache is being invalidate because project 9704ab3ae99843b59a635387844c55d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:27.396988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.398303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.404279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1194/2375] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:26 2022] DELETE /identity/v3/projects/9704ab3ae99843b59a635387844c55d0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:27.409209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:27.425760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b874-4713-4b0e-82f3-691868a2e6fc service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:27.529602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:27.536918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:27.536918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:27.536918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] PATH_INFO: `/v3/users/af1d095cace840b6ae9aa77db2418171` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:27.536918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1d095cace840b6ae9aa77db2418171)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:27.536918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:27.767259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1d095cace840b6ae9aa77db2418171'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.796946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1d095cace840b6ae9aa77db2418171'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.906699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1d095cace840b6ae9aa77db2418171'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.948981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1d095cace840b6ae9aa77db2418171'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.956819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1d095cace840b6ae9aa77db2418171'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:27.963484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1182/2376] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:27 2022] DELETE /identity/v3/users/af1d095cace840b6ae9aa77db2418171 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:28.581177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:28.594065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:28.599937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:28.617309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2006f1-e866-4da4-9ae3-35f1767bf864 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:28.751508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:28.752286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:28.753094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:28.753415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] PATH_INFO: `/v3/projects/35cca3fc09be4633b2e81217cee6881a` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:28.754781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cca3fc09be4633b2e81217cee6881a)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:28.768189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:29.408356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cca3fc09be4633b2e81217cee6881a', 'request_id': 'req-b41264ff-64ab-4ae2-ad84-b3f115744b7e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:29.429183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cca3fc09be4633b2e81217cee6881a', 'request_id': 'req-b41264ff-64ab-4ae2-ad84-b3f115744b7e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:29.435312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cca3fc09be4633b2e81217cee6881a', 'request_id': 'req-b41264ff-64ab-4ae2-ad84-b3f115744b7e'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:29.553291 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] The token cache is being invalidate because project 35cca3fc09be4633b2e81217cee6881a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:29.553765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:29.558760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:29.560346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1195/2377] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:28 2022] DELETE /identity/v3/projects/35cca3fc09be4633b2e81217cee6881a => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:29.564814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:29.566910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:29.582263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f0b9a-e082-4d46-b1e9-4d77fb923e68 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:29.695908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:29.699698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:29.699698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:29.699698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:29.699698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] PATH_INFO: `/v3/users/aa6fe8912a614a6ab404e33a44300a6a` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:29.700626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6fe8912a614a6ab404e33a44300a6a)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:29.702799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:30.003541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6fe8912a614a6ab404e33a44300a6a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:30.019834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6fe8912a614a6ab404e33a44300a6a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:30.137312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6fe8912a614a6ab404e33a44300a6a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:30.159039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6fe8912a614a6ab404e33a44300a6a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:30.160113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-25378cbb-ce1c-42f6-8986-a0af186530ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6fe8912a614a6ab404e33a44300a6a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:30.168618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1183/2378] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:29 2022] DELETE /identity/v3/users/aa6fe8912a614a6ab404e33a44300a6a => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:31.017437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:31.026789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:31.057603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41264ff-64ab-4ae2-ad84-b3f115744b7e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:31.161243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:31.162134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:31.162571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:31.162982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] PATH_INFO: `/v3/projects/d2235fb88c89460fbdf898b21ccab03c` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:31.164691 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2235fb88c89460fbdf898b21ccab03c)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:31.176785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:31.329219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2235fb88c89460fbdf898b21ccab03c', 'request_id': 'req-52da124a-ea95-4326-87aa-71ac0eaff99a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:31.341838 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2235fb88c89460fbdf898b21ccab03c', 'request_id': 'req-52da124a-ea95-4326-87aa-71ac0eaff99a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:31.349021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2235fb88c89460fbdf898b21ccab03c', 'request_id': 'req-52da124a-ea95-4326-87aa-71ac0eaff99a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:31.459360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] The token cache is being invalidate because project d2235fb88c89460fbdf898b21ccab03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:31.460144 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:31.461293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-52da124a-ea95-4326-87aa-71ac0eaff99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:31.463837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1196/2379] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:31 2022] DELETE /identity/v3/projects/d2235fb88c89460fbdf898b21ccab03c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:31.469196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725974be-ab60-480a-a609-1debf01ad07f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:31.469196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725974be-ab60-480a-a609-1debf01ad07f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:31.470114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725974be-ab60-480a-a609-1debf01ad07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:31.500577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-725974be-ab60-480a-a609-1debf01ad07f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:31.502521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-725974be-ab60-480a-a609-1debf01ad07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:31.611669 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1184/2380] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:31.613647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:31.613950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:31.614236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:31.636489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:31.637749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:31.654285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725974be-ab60-480a-a609-1debf01ad07f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:31.660411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1197/2381] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:31.668561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725974be-ab60-480a-a609-1debf01ad07f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:31.673949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:31.674878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:31.675235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:31.675674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:31.676508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:31.676898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:31.679246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:31.693475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1185/2382] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:05:31.701954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:31.717419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c620f-dbd6-4227-be97-e8d9343e8e6b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:31.725049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:31.731268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:31.731268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:31.731268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:31.731268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:31.731268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:31.892031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1198/2383] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:31 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:31.903544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:31.919352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940aec7-9dea-4be5-806a-08a67137779e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:32.047325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:32.048558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.048910 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.049258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.050143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:32.052264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:32.112013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:32.171562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1186/2384] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:31 2022] POST /identity/v3/users => generated 291 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:32.172271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:32.185389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e46c-d095-4059-be2d-066e54246c06 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:32.198029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:32.203423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.203423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.203423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.203423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:32.203423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:32.219786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1199/2385] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:05:32.219977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:32.235175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68921a3-d54c-47be-bc6e-0c811c2db13e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:32.248617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:32.249249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.249561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.249811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.250462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:32.252267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e903c5-d126-4993-9911-7d5e2a2a8b51 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:32.277661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1187/2386] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:05:32.292489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:32.312968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaba4-faa6-4e9e-9ea5-f54581c774ea admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:32.332939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:32.333917 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.334349 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.334865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] PATH_INFO: `/v3/projects/3b283f0ca16f4e8a975812f81a9deecc/users/be32a4ec9c25448a9467a807e75b6dca/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.375809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b283f0ca16f4e8a975812f81a9deecc, user_id=be32a4ec9c25448a9467a807e75b6dca, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:32.378494 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:32.524050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe5915-a5f0-4db6-83b5-b3e2833c74da None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.527567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe5915-a5f0-4db6-83b5-b3e2833c74da None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.528106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe5915-a5f0-4db6-83b5-b3e2833c74da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.531133 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1200/2387] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:32 2022] PUT /identity/v3/projects/3b283f0ca16f4e8a975812f81a9deecc/users/be32a4ec9c25448a9467a807e75b6dca/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:32.568826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-30fe5915-a5f0-4db6-83b5-b3e2833c74da None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:32.571974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-30fe5915-a5f0-4db6-83b5-b3e2833c74da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:32.675156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1188/2388] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:32.691875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:32.701725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:32.709009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.709371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.709576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.734505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] MFA Rules not processed for user `4bc63726077349f3bb728041975fecba`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:32.735789 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:32.793271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83940c-b7cb-4256-8055-e9045887d3d0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:32.797322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:32.797878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:32.798307 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:32.798583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:32.811593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:32.813183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d862-7015-4493-a499-2b69b70901f0 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:32.817569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1189/2389] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:32.829671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1201/2390] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:05:33.461110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:33.587179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:33.589471 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:33.609147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a1527-1602-42b8-acd5-466be2ae56e0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:33.615154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:33.615994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:33.616495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:33.616872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] PATH_INFO: `/v3/users/911f8cad768345c4861cd17cba7ce9a5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:33.618212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=911f8cad768345c4861cd17cba7ce9a5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:33.620339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:34.002343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911f8cad768345c4861cd17cba7ce9a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:34.017061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911f8cad768345c4861cd17cba7ce9a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:34.111792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911f8cad768345c4861cd17cba7ce9a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:34.126809 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911f8cad768345c4861cd17cba7ce9a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:34.127778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911f8cad768345c4861cd17cba7ce9a5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:34.154061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1190/2391] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:33 2022] DELETE /identity/v3/users/911f8cad768345c4861cd17cba7ce9a5 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:34.156706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:34.157241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:34.157241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:34.183490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:34.188664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:34.321393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1202/2392] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:34.346838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:34.348418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:34.450952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a807e-3432-45c1-b3fb-4695b4ddb4bf admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:34.456437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:34.457542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:34.457542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:34.457542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:34.471303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:34.473401 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7d87-3b46-4b0c-9b0e-f7369b9d285b service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:34.495726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1191/2393] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:34.992920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=79,keystone:INSERT=5,keystone:DELETE=16 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:35.145795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:35.148340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.173929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915982c-20ba-4ff8-9f0f-295a3d799f3f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:35.184902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.185313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.185524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.187277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:35.188840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.189681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.190102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] PATH_INFO: `/v3/projects/edc32ff8ca8d41f68a7ab107a7f2de7d` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.193503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc32ff8ca8d41f68a7ab107a7f2de7d)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:35.197166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:35.249638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] MFA Rules not processed for user `be32a4ec9c25448a9467a807e75b6dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:35.251278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.339394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc32ff8ca8d41f68a7ab107a7f2de7d', 'request_id': 'req-e0ec12ed-a043-41df-96f1-8aed2ea843b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:35.355011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc32ff8ca8d41f68a7ab107a7f2de7d', 'request_id': 'req-e0ec12ed-a043-41df-96f1-8aed2ea843b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:35.358145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1192/2394] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:35.362130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc32ff8ca8d41f68a7ab107a7f2de7d', 'request_id': 'req-e0ec12ed-a043-41df-96f1-8aed2ea843b6'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:35.370519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:35.372427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.444158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d159c-bd3d-4099-b0f5-66fbb8263c41 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:35.452937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] The token cache is being invalidate because project edc32ff8ca8d41f68a7ab107a7f2de7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:35.453559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:35.454468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e0ec12ed-a043-41df-96f1-8aed2ea843b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:35.456649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1203/2395] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:35 2022] DELETE /identity/v3/projects/edc32ff8ca8d41f68a7ab107a7f2de7d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:35.464100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7991-85f4-45c5-9e1b-a02183bf5805 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.464554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7991-85f4-45c5-9e1b-a02183bf5805 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.464850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f7991-85f4-45c5-9e1b-a02183bf5805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.489167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7f7f7991-85f4-45c5-9e1b-a02183bf5805 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:35.495489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7f7f7991-85f4-45c5-9e1b-a02183bf5805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.520218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:35.521026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.521424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.521770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.523964 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.587563 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1204/2396] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:35.589072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.589435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.589782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.620833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:35.622387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:35.633963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1205/2397] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:35.638192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:35.649419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7198c-144f-49a7-bb0b-6fb16dc7262c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:35.662244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:35.662905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.670026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.670330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.673498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:35.673819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:35.674350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:35.676036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:35.676261 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:35.700363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1206/2398] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:35.704580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1193/2399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:35.704880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:35.720785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49994-07b8-49e6-bac1-4637e6b311d6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:35.728615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:35.729337 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.729683 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.730033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.730774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:35.733721 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:35.862179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1207/2400] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:35 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:05:35.866697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:35.885160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195339b0-6691-431b-93a6-64a13b8bda3b service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:35.967338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:35.970223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:35.970223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:35.970223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:35.970223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:35.972072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:36.108624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1194/2401] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:35 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:36.110498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:36.125063 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa896-99d3-4f77-b23f-bf40139991d9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:36.131961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:36.132673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:36.132947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:36.133241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:36.133892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:36.135730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:36.146591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1208/2402] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:36.151237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:36.163801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625322-2244-4f2d-b5e9-f212ffded15b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:36.169543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:36.170158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:36.170572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:36.170854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:36.171506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:36.177274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed151e-c1f4-44cf-9309-5c1366857b8d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:36.189819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1195/2403] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:36.190913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:36.204456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b7a4-8f47-4cf0-83dd-431a09b1b220 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:36.209414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:36.210631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:36.210982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:36.211272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] PATH_INFO: `/v3/projects/3007136fd85e4e79b250f619dbeb9524/users/d3c08af4d17749b49bd6f681999a18f8/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:36.229822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3007136fd85e4e79b250f619dbeb9524, user_id=d3c08af4d17749b49bd6f681999a18f8, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:36.243321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:36.348983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1209/2404] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:36 2022] PUT /identity/v3/projects/3007136fd85e4e79b250f619dbeb9524/users/d3c08af4d17749b49bd6f681999a18f8/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:36.351440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1767-c5b7-4a8f-826e-55659513fb03 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:36.352234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1767-c5b7-4a8f-826e-55659513fb03 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:36.352667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1767-c5b7-4a8f-826e-55659513fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:36.409472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ed8c1767-c5b7-4a8f-826e-55659513fb03 None None] MFA Rules not processed for user `d3c08af4d17749b49bd6f681999a18f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:36.411737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ed8c1767-c5b7-4a8f-826e-55659513fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:36.534494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:36.539444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1196/2405] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:36.574343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:36.576371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:36.653613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2311d62-285b-4ed8-b087-2304d182b876 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:36.659249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:36.659976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:36.660462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:36.660749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:36.672199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:36.673647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7144b-5b87-4e7d-9b71-d58d9241a19d service glance] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:36.691015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1210/2406] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:37.595455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:37.596063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:37.596063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:37.615209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] MFA Rules not processed for user `be32a4ec9c25448a9467a807e75b6dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:37.616467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:37.671367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1197/2407] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:38.009606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:38.557467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:39.365702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b6306-78ad-4e4d-be99-c8e412a8106c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:39.366414 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b6306-78ad-4e4d-be99-c8e412a8106c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:39.367561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b6306-78ad-4e4d-be99-c8e412a8106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:39.394560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e22b6306-78ad-4e4d-be99-c8e412a8106c None None] MFA Rules not processed for user `14caeeea3623495c87977ea71af4aad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:39.395930 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e22b6306-78ad-4e4d-be99-c8e412a8106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:39.490875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1211/2408] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:40.025647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:40.277368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:40.848923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:41.717943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:42.037530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:42.191865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:43.566687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:43.568174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:43.656842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a724-fa2e-4812-ac44-e83527be9c0b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:43.663295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:43.664089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:43.664367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:43.664631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] PATH_INFO: `/v3/users/06a5e25e11a0499581f0a7940231a57f` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:43.665976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a5e25e11a0499581f0a7940231a57f)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:43.667920 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:43.885269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a5e25e11a0499581f0a7940231a57f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:43.893064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a5e25e11a0499581f0a7940231a57f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:43.962873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a5e25e11a0499581f0a7940231a57f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:44.000488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a5e25e11a0499581f0a7940231a57f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:44.001814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a5e25e11a0499581f0a7940231a57f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:44.008396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1198/2409] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:43 2022] DELETE /identity/v3/users/06a5e25e11a0499581f0a7940231a57f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:44.013882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:44.014328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:44.014495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:44.039242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:44.041134 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:44.089818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:44.193603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1212/2410] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:44.266541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:44.269321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:44.288867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:44.432177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d444a-4aae-4dcd-9181-be616ae83a05 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:44.437142 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:44.437860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:44.438211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:44.438552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:44.449524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:44.451359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b08b2-d366-4fe9-9769-d131d642d67f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:44.463524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1199/2411] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:45.203420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:45.205649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.226170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c4b6-2e9b-4f9d-b907-3ebff7309b28 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:45.236159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:45.239226 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.240097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.242714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] PATH_INFO: `/v3/projects/54efbba9173b487c8275c191e50aad70` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.246041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54efbba9173b487c8275c191e50aad70)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:45.256009 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:45.427728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74bab-6466-43b8-ab7e-934f4b0f1792 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.427728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74bab-6466-43b8-ab7e-934f4b0f1792 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.427728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74bab-6466-43b8-ab7e-934f4b0f1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.470799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9da74bab-6466-43b8-ab7e-934f4b0f1792 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:45.472155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9da74bab-6466-43b8-ab7e-934f4b0f1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.475849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54efbba9173b487c8275c191e50aad70', 'request_id': 'req-f2d000ba-2a8b-4e0c-ad1a-704430012798'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:45.490121 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54efbba9173b487c8275c191e50aad70', 'request_id': 'req-f2d000ba-2a8b-4e0c-ad1a-704430012798'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:45.519230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54efbba9173b487c8275c191e50aad70', 'request_id': 'req-f2d000ba-2a8b-4e0c-ad1a-704430012798'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:45.568861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1200/2412] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:45.596880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] The token cache is being invalidate because project 54efbba9173b487c8275c191e50aad70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:45.596880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:45.596880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:45.604208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e217-5afe-48b3-8c2b-4681771c34c9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.604324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1213/2413] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:45 2022] DELETE /identity/v3/projects/54efbba9173b487c8275c191e50aad70 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:45.604417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e217-5afe-48b3-8c2b-4681771c34c9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.604417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e217-5afe-48b3-8c2b-4681771c34c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.622652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:45.626915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.638194 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3d46e217-5afe-48b3-8c2b-4681771c34c9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:45.641416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3d46e217-5afe-48b3-8c2b-4681771c34c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.767096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1201/2414] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:45.777582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.777582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.777582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.793329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d000ba-2a8b-4e0c-ad1a-704430012798 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:45.812193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:45.813318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.817017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:45.818392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.818894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.819955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.822698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:45.826277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1202/2415] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:45.831653 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:45.839904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:45.842310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4b52-fd3b-4c88-bc8c-635ec7982dc6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:45.844391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:45.847277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:45.847898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.848178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.848481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.849145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:45.849449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:45.851314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:45.859239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1214/2416] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 18:05:45.869196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1203/2417] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:45.873004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:45.885619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33b8e-673b-4456-9290-c7a7b9119f10 service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:45.890345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:45.890979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:45.891263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:45.891539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:45.892167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:45.894278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:46.047599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1215/2418] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:45 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:46.050899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:46.114862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf502e-665d-44c0-a428-3d6d1ee9a468 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:46.273091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:46.281468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:46.282370 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.282636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.282956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:46.283614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:46.285800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:46.400844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1204/2419] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:46 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:46.402231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:46.423908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09c01-5a5b-4195-b9e0-b10c3d2ad733 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:46.443607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:46.444436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.444818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.445774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:46.446031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:46.448304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:46.475059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1216/2420] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:46.476791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:46.496451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d116-6e5a-42d9-bceb-3bdf3967bd45 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:46.518717 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:46.519642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.520048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.520422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:46.521202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:46.523716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa8a1d-eada-4830-b1b5-47b33f7c2710 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:46.531569 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:46.555663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1205/2421] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:46.560829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:46.585960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bafe9-31ce-4e88-afaf-eaa63d61408a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:46.592546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:46.593692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.594374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.594970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] PATH_INFO: `/v3/projects/47cb4da3460a444182da9ca1de828a3a/users/b77c2f0bf70a4aa1abc099b85330d8d5/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:46.619385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cb4da3460a444182da9ca1de828a3a, user_id=b77c2f0bf70a4aa1abc099b85330d8d5, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:46.622422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe16a-842e-478f-af92-50ec99a2c251 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:46.727140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1217/2422] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:46 2022] PUT /identity/v3/projects/47cb4da3460a444182da9ca1de828a3a/users/b77c2f0bf70a4aa1abc099b85330d8d5/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:46.740098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.740950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.742416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:46.797976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] MFA Rules not processed for user `b77c2f0bf70a4aa1abc099b85330d8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:46.807127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:46.921324 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:46.922738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:46.923287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.014568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] MFA Rules not processed for user `9e9d73e445d24516a0a85bf897203564`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:47.018908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:47.034440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1206/2423] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:47.038571 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:47.199802 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3705e8-3922-4dbd-ab11-ad5898f8a3b8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:47.208583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1218/2424] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:47.210256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:47.212246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:47.212804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:47.213268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.214388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:47.217715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:47.333322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1207/2425] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:47 2022] POST /identity/v3/projects => generated 375 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:47.339694 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:47.353548 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ee2b-e425-407a-afeb-0a1f48d3b30c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:47.429873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:47.431529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:47.432146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:47.432651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.434064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:47.436980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:47.541689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1219/2426] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:47 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:05:47.552244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:47.597501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01a29b-18c5-4ef4-b0ae-38256f08a446 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:47.605308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:47.605308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:47.605308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:47.605308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.611946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:47.618568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:47.634769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1208/2427] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:47.640393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:47.664055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc67afc-d6ce-4f6f-b2a2-cbe11c696958 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:47.673457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:47.674468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:47.675067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:47.675967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] PATH_INFO: `/v3/projects/b3c6a4455888491f94103b4cded6a691/users/487a5f5c98f24e7d94e6fc9c6a49e6b7/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.700555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c6a4455888491f94103b4cded6a691, user_id=487a5f5c98f24e7d94e6fc9c6a49e6b7, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:47.705201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:47.884746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1220/2428] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:47 2022] PUT /identity/v3/projects/b3c6a4455888491f94103b4cded6a691/users/487a5f5c98f24e7d94e6fc9c6a49e6b7/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:47.891811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:47.902958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042291f-53ec-463f-83ff-534ffc535bab admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:47.992057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:47.992770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:47.993096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:47.993548 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:47.994316 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:47.995980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841808-4774-4cad-9663-5e63916c2094 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:48.014814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1209/2429] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:48.017827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:48.034001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ed6a-b3b7-4ec5-bfa9-c7b1131250fa admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:48.043661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:48.045116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:48.045411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:48.045730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] PATH_INFO: `/v3/projects/b3c6a4455888491f94103b4cded6a691/users/487a5f5c98f24e7d94e6fc9c6a49e6b7/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:48.057884 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c6a4455888491f94103b4cded6a691, user_id=487a5f5c98f24e7d94e6fc9c6a49e6b7, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:48.060997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:48.082498 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1221/2430] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:48 2022] PUT /identity/v3/projects/b3c6a4455888491f94103b4cded6a691/users/487a5f5c98f24e7d94e6fc9c6a49e6b7/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:48.093900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:48.094239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:48.094542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:48.170337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] MFA Rules not processed for user `487a5f5c98f24e7d94e6fc9c6a49e6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:48.172638 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:48.364737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1210/2431] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:48.381583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:48.384062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:48.499417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9700-8a16-46cb-bb3d-fd96eb2a33df admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:48.504029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:48.504897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:48.505438 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:48.506047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:48.633779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:48.636272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7319d-9222-4869-8c95-e1da779ae0de service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:48.647895 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1222/2432] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:48.740259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:49.174537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:50.803192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:51.466021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:52.041431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:52.142057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da232-aed1-424a-bae8-4d9ff77e8e6b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:52.146997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:52.148519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:52.149393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:52.149393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] PATH_INFO: `/v3/users/b77c2f0bf70a4aa1abc099b85330d8d5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:52.150325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77c2f0bf70a4aa1abc099b85330d8d5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:52.152358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:52.384849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77c2f0bf70a4aa1abc099b85330d8d5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:52.396742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77c2f0bf70a4aa1abc099b85330d8d5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:52.488266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77c2f0bf70a4aa1abc099b85330d8d5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:52.503170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77c2f0bf70a4aa1abc099b85330d8d5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:52.503989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77c2f0bf70a4aa1abc099b85330d8d5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:52.515270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1211/2433] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:52 2022] DELETE /identity/v3/users/b77c2f0bf70a4aa1abc099b85330d8d5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:52.516120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:52.516621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:52.516729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:52.546904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:52.556636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:52.691250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1223/2434] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:05:52.700202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:52.702167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:52.797084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ec04-a492-48af-b66c-8c28173dd376 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:52.800889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:52.801503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:52.801781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:52.802052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:52.813296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:52.815112 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:52.828694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1212/2435] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:53.271636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:53.279048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:53.280603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:53.308255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2782e-ce65-492d-94f0-7eb0af3581c9 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:53.314513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:53.319280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:53.319728 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:53.320115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] PATH_INFO: `/v3/projects/47cb4da3460a444182da9ca1de828a3a` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:53.321655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cb4da3460a444182da9ca1de828a3a)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:53.324074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:53.454550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cb4da3460a444182da9ca1de828a3a', 'request_id': 'req-ca7d5fac-0d04-4ee2-be04-417774fef8ac'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.461767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cb4da3460a444182da9ca1de828a3a', 'request_id': 'req-ca7d5fac-0d04-4ee2-be04-417774fef8ac'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.467497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cb4da3460a444182da9ca1de828a3a', 'request_id': 'req-ca7d5fac-0d04-4ee2-be04-417774fef8ac'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.557952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] The token cache is being invalidate because project 47cb4da3460a444182da9ca1de828a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:53.558667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.559254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.560788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1224/2436] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:53 2022] DELETE /identity/v3/projects/47cb4da3460a444182da9ca1de828a3a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:53.573463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:53.581402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05773b74-c4f6-430f-8bba-ba2ebf9218f8 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:53.594517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:53.710663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:53.710663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:53.710663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:53.710663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] PATH_INFO: `/v3/users/487a5f5c98f24e7d94e6fc9c6a49e6b7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:53.711054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487a5f5c98f24e7d94e6fc9c6a49e6b7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:53.711054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:53.973658 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487a5f5c98f24e7d94e6fc9c6a49e6b7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:53.981992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487a5f5c98f24e7d94e6fc9c6a49e6b7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.054498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487a5f5c98f24e7d94e6fc9c6a49e6b7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.069211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487a5f5c98f24e7d94e6fc9c6a49e6b7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.070794 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-c985445d-4b74-49a5-a267-46decde5a6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487a5f5c98f24e7d94e6fc9c6a49e6b7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.077495 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1213/2437] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:05:53 2022] DELETE /identity/v3/users/487a5f5c98f24e7d94e6fc9c6a49e6b7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:05:54.517772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:54.549364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:54.550938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:54.575651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d5fac-0d04-4ee2-be04-417774fef8ac admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:54.669770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:54.669770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:54.669770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:54.670091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] PATH_INFO: `/v3/projects/b3c6a4455888491f94103b4cded6a691` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:54.671166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c6a4455888491f94103b4cded6a691)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:54.673143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:54.854633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c6a4455888491f94103b4cded6a691', 'request_id': 'req-f5a3df5b-e768-49cb-8350-df57429684a7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.868762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c6a4455888491f94103b4cded6a691', 'request_id': 'req-f5a3df5b-e768-49cb-8350-df57429684a7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.889025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c6a4455888491f94103b4cded6a691', 'request_id': 'req-f5a3df5b-e768-49cb-8350-df57429684a7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.986195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] The token cache is being invalidate because project b3c6a4455888491f94103b4cded6a691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:05:54.986499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.987263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f5a3df5b-e768-49cb-8350-df57429684a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:05:54.990252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1225/2438] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:05:54 2022] DELETE /identity/v3/projects/b3c6a4455888491f94103b4cded6a691 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:54.997282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:54.997801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:54.997801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.035034 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:55.036451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:55.066864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:55.133520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1214/2439] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:55.135511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44080207-0add-44ec-94c0-02547d854429 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.136094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44080207-0add-44ec-94c0-02547d854429 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.136449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44080207-0add-44ec-94c0-02547d854429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.161436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-44080207-0add-44ec-94c0-02547d854429 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:55.164004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-44080207-0add-44ec-94c0-02547d854429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:55.174066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1226/2440] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:55.178160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.196453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeabd5-a9a4-4e2f-ab7e-1926bcabf59e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.203171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.203971 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.204294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.204634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.205360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:05:55.205732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.207547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.228406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1215/2441] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:05:55.233138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44080207-0add-44ec-94c0-02547d854429 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.243640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44080207-0add-44ec-94c0-02547d854429 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.248599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.249239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.249517 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.249787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.250421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.252381 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.421983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1227/2442] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:05:55 2022] POST /identity/v3/projects => generated 363 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:05:55.425968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.435819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506d5da-568a-4736-8710-e8d2298653e4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.490241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.490848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.491132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.491395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.492088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.493970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.649808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1216/2443] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:05:55 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:05:55.654243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.668389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d411bed-a773-40c6-b148-9ebb4d6a3b0b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.673818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.675170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.675457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.675740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.676397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.678442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.692931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1228/2444] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:55.704918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.722093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53542ce6-9efb-4e0b-9eee-65a2b2f52b49 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.728368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.728985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.729343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.729739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.730297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.733915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b3519-02e5-4abc-9ece-ff19c186556b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.747702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1217/2445] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:05:55.749122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:55.761391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86138-2892-444b-80e0-ba439d9ec5b8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:55.769500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:55.770992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.771279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.771556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] PATH_INFO: `/v3/projects/6745adce3e7f49eeac23a02d130d1399/users/db38c0a3540a46e897ea0cb1068bb991/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.788925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6745adce3e7f49eeac23a02d130d1399, user_id=db38c0a3540a46e897ea0cb1068bb991, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:55.791890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:55.894849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1229/2446] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:05:55 2022] PUT /identity/v3/projects/6745adce3e7f49eeac23a02d130d1399/users/db38c0a3540a46e897ea0cb1068bb991/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:05:55.905302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:55.905749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:55.906023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:55.957902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] MFA Rules not processed for user `db38c0a3540a46e897ea0cb1068bb991`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:05:55.959441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:56.068670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1218/2447] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:05:56.079126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:05:56.080887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:05:56.151867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:56.175343 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f7d5-21fd-4db5-b3d4-5b64dd2b1bbe admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:05:56.179637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:05:56.180425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:05:56.180704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:05:56.180978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:05:56.190900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:05:56.191852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29268b83-c9c4-4957-bec8-edeb4c70b901 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:05:56.204417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1230/2448] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:05:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:05:56.940912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=85,keystone:DELETE=9,keystone:INSERT=6 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:57.900215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:59.214404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:59.888739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:00.872419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:01.277185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:02.277758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:03.580448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:05.895252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:06.660220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:08.031339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:08.312738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:08.477993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:08.480893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:08.565715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c240a1-a311-4c76-b630-e0616003b5f7 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:08.572084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:08.572725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:08.573190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:08.573463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] PATH_INFO: `/v3/users/d3c08af4d17749b49bd6f681999a18f8` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:08.574612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c08af4d17749b49bd6f681999a18f8)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:08.576956 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:08.728716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c08af4d17749b49bd6f681999a18f8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:08.757591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c08af4d17749b49bd6f681999a18f8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:08.831519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c08af4d17749b49bd6f681999a18f8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:08.847763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c08af4d17749b49bd6f681999a18f8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:08.848500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c08af4d17749b49bd6f681999a18f8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:08.855589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1219/2449] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:06:08 2022] DELETE /identity/v3/users/d3c08af4d17749b49bd6f681999a18f8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:08.860422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:08.860734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:08.861006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:08.892021 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:08.893317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:08.971525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1231/2450] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:06:08.984734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:08.984734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:09.043030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065ac5-c7a1-4c51-b31f-d2765b425679 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:09.046775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:09.047371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:09.047650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:09.048479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:09.058383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:09.059858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01656-96bd-4e1d-858d-fce729cd2e46 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:09.070252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1220/2451] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:09.544231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:09.545741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:09.563267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb999f4-98a2-4236-b578-1f30a884ee61 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:09.570399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:09.572419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:09.573037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:09.573630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] PATH_INFO: `/v3/projects/3007136fd85e4e79b250f619dbeb9524` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:09.576870 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3007136fd85e4e79b250f619dbeb9524)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:09.579231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:09.643505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:09.699088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3007136fd85e4e79b250f619dbeb9524', 'request_id': 'req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:09.706440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3007136fd85e4e79b250f619dbeb9524', 'request_id': 'req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:09.714340 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3007136fd85e4e79b250f619dbeb9524', 'request_id': 'req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:09.797413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] The token cache is being invalidate because project 3007136fd85e4e79b250f619dbeb9524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:06:09.797801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:09.798533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f50fee66-bd53-4ab6-bdf5-88f37503d8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:09.800202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1232/2452] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:06:09 2022] DELETE /identity/v3/projects/3007136fd85e4e79b250f619dbeb9524 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:09.805759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:09.806046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:09.806321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:09.829202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:09.830421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:09.897145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1221/2453] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:09.908464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:09.908464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:09.908464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:09.936419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:09.937833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:09.948398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1233/2454] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:06:09.953227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:09.964294 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39c80b-81af-41c3-a926-bbcd1cd2fa8c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:09.970604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:09.971758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:09.972044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:09.972467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:09.973275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:06:09.973728 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:09.975436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:09.995531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1222/2455] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:06:10.003116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.012801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547da3-11a0-4585-ad4f-ec5414bfe6aa None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.018385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.019106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.023211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.023211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.023211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.023211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.124186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:10.139932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1234/2456] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:06:10 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:10.144277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.156169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3abc-2ddf-468e-addd-54fd8ed16c96 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.218609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.219324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.219600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.219871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.220507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.230694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.309477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1223/2457] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:06:10 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:10.310950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.323159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05396b3-c503-4c1f-a4c8-eb832bdccdc8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.328850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.329529 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.329947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.330236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.330908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.332571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.343889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1235/2458] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:06:10.347989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.363664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a497-422a-4720-b743-712994d4eb03 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.368723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.369319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.369591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.369855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.370497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.372185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818537b-e3a8-439c-a2ab-8f5d38fbebfb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.385919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1224/2459] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:06:10.394426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.409138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205e45-0157-4199-967b-66e175258b09 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.414522 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.415302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.415580 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.415854 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] PATH_INFO: `/v3/projects/bef5dab8d21b4b0da55b316f6e3008d3/users/d7c7b65b62b542258b91fe65b9cc1985/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.432094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef5dab8d21b4b0da55b316f6e3008d3, user_id=d7c7b65b62b542258b91fe65b9cc1985, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.434790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.546303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1236/2460] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:06:10 2022] PUT /identity/v3/projects/bef5dab8d21b4b0da55b316f6e3008d3/users/d7c7b65b62b542258b91fe65b9cc1985/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:10.556804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.557766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.558095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.591735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] MFA Rules not processed for user `d7c7b65b62b542258b91fe65b9cc1985`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:10.595476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:10.658209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1225/2461] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:10.669132 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:10.670940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:10.728923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2990c-1298-40bd-9fb6-047a5b6a6b8a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:10.740750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:10.746357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:10.747087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:10.747356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:10.747625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:10.763328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:10.764906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:10.774807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1237/2462] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:11.369138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:12.380180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:12.637621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:13.340462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:13.483350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:14.374197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:14.589872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:14.654305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:15.026781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:15.524047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:16.317912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:16.488530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:16.752880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:17.018505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:17.259711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:17.289578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:17.833013 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:17.928497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:18.394470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:18.396610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:18.459874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8308e9-1463-4982-a0c4-cef0814a907c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:18.467545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:18.468326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:18.468672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:18.469013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:18.472050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:18.547734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:18.549361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9109-3562-4722-b462-df6cb656d626 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:18.563102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1226/2463] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:18.809433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:18.848769 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:19.099812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:19.174418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:19.518382 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:19.831873 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:20.094214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:20.404021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:20.832439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:21.004762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:21.561321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:21.930557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:22.713160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:22.923439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.090323 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:23.111462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.154007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bcb05-4490-4628-86f7-376d7aafe10a service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:23.158573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:23.159221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:23.159500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:23.159774 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] PATH_INFO: `/v3/users/d7c7b65b62b542258b91fe65b9cc1985` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:23.160922 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c7b65b62b542258b91fe65b9cc1985)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:23.166859 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:23.300336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.348909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c7b65b62b542258b91fe65b9cc1985'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:23.359491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c7b65b62b542258b91fe65b9cc1985'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:23.426431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c7b65b62b542258b91fe65b9cc1985'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:23.427090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c7b65b62b542258b91fe65b9cc1985'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:23.441288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c7b65b62b542258b91fe65b9cc1985'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:23.452032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1238/2464] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:06:23 2022] DELETE /identity/v3/users/d7c7b65b62b542258b91fe65b9cc1985 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:23.454615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:23.455187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:23.455555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:23.475518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:23.477505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:23.536781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1227/2465] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:23.550516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:23.552212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:23.612541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f6066-60c3-4022-a5f0-850eba16d88a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:23.616287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:23.616913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:23.617185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:23.617455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:23.626923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:23.628411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3ffc7-738e-4101-803a-74cc843349cf service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:23.642997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1239/2466] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:23.968981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:24.111626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:24.174875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:24.176216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:24.195617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f22a0-7aae-45e7-9fd7-e9ee5652e424 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:24.202860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:24.203697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:24.204254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:24.204626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] PATH_INFO: `/v3/projects/bef5dab8d21b4b0da55b316f6e3008d3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:24.206044 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef5dab8d21b4b0da55b316f6e3008d3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:24.208252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:24.341399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef5dab8d21b4b0da55b316f6e3008d3', 'request_id': 'req-cd668203-bc8e-47e2-817e-ba25a357119f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:24.347013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef5dab8d21b4b0da55b316f6e3008d3', 'request_id': 'req-cd668203-bc8e-47e2-817e-ba25a357119f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:24.442230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef5dab8d21b4b0da55b316f6e3008d3', 'request_id': 'req-cd668203-bc8e-47e2-817e-ba25a357119f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:24.455421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] The token cache is being invalidate because project bef5dab8d21b4b0da55b316f6e3008d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:06:24.455829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:24.456610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:24.458188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1228/2467] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:06:24 2022] DELETE /identity/v3/projects/bef5dab8d21b4b0da55b316f6e3008d3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:24.590231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.043320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.231287 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.300231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.524118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.562045 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.683217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.768557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.802934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.888807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:25.974406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.066301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.180094 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.271497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.357247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.436689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.499975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.694351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.730355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.922545 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:26.957306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.094590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.157374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.357148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.437116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.528424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.597391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.634494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.802708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.894347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:27.917460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.031537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.053953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.094449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.117866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.237337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.265642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.511842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.548048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.740312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.786076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.951278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:28.985958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.042921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.139959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.168753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.237547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.305599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.369294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.608497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.683725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.705946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.934860 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:29.974187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:30.231302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:30.328945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:30.437097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:31.233215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da6cf-568c-46a5-9a2b-ef4750f0fae1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:31.233726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da6cf-568c-46a5-9a2b-ef4750f0fae1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:31.233844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da6cf-568c-46a5-9a2b-ef4750f0fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:31.253648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d07da6cf-568c-46a5-9a2b-ef4750f0fae1 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:31.254938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d07da6cf-568c-46a5-9a2b-ef4750f0fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:31.313655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1240/2468] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:31.336409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:31.337986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:31.411459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668203-bc8e-47e2-817e-ba25a357119f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:31.416526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:31.417124 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:31.417406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:31.417721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:31.424015 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:31.426351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:31.427987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:31.436429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1229/2469] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:06:41.305696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=55,keystone:DELETE=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:41.579309 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:41.925280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:41.925857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:41.926394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:41.954240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:41.956375 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:42.030937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1241/2470] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:06:42.046895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:42.048714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:42.155274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf7a9-1604-46a3-bff1-efcb82c11217 service swift] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:42.161692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:42.162615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:42.163042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:42.163413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:42.173820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:42.175819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97cef5-8c5c-4762-a0fe-75759389ee11 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:42.200723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1230/2471] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:44.628295 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:44.630036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:44.643549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ce9b-c70e-4d26-8009-2197341b2837 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:44.648490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:44.649235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:44.649589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:44.649934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] PATH_INFO: `/v3/users/db38c0a3540a46e897ea0cb1068bb991` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:44.651193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db38c0a3540a46e897ea0cb1068bb991)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:44.653263 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:44.881900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db38c0a3540a46e897ea0cb1068bb991'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:44.891282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db38c0a3540a46e897ea0cb1068bb991'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:44.962872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db38c0a3540a46e897ea0cb1068bb991'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:44.964074 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db38c0a3540a46e897ea0cb1068bb991'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:44.982827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db38c0a3540a46e897ea0cb1068bb991'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:44.995012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1242/2472] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:06:44 2022] DELETE /identity/v3/users/db38c0a3540a46e897ea0cb1068bb991 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:06:45.001022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:45.001552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:45.001978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:45.035754 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:45.037758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:45.133342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1231/2473] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:45.140795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:45.142479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:45.209648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f251ca-dc08-448d-b76d-0b060ddab938 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:45.214931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:45.215716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:45.215993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:45.216457 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:45.227161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:45.228616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb99dc-2f41-4ca6-9614-41418971ba6a service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:45.239857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1243/2474] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:06:45.888168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:45.889835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:45.904303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888077b-a6e0-40cc-aff4-77ff76885dd0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:45.920127 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:45.920820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:45.921084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:45.921378 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] PATH_INFO: `/v3/projects/6745adce3e7f49eeac23a02d130d1399` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:45.923460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6745adce3e7f49eeac23a02d130d1399)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:45.927677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.083699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6745adce3e7f49eeac23a02d130d1399', 'request_id': 'req-1060884e-3050-4bd6-aed6-01ad43e02ad1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:46.093975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6745adce3e7f49eeac23a02d130d1399', 'request_id': 'req-1060884e-3050-4bd6-aed6-01ad43e02ad1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:46.179155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6745adce3e7f49eeac23a02d130d1399', 'request_id': 'req-1060884e-3050-4bd6-aed6-01ad43e02ad1'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:46.194837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] The token cache is being invalidate because project 6745adce3e7f49eeac23a02d130d1399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:06:46.195318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:46.197021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-1060884e-3050-4bd6-aed6-01ad43e02ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:46.199594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1232/2475] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:06:45 2022] DELETE /identity/v3/projects/6745adce3e7f49eeac23a02d130d1399 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:46.205605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.206216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.206216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.226965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:46.228532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:46.239660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:46.301589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1244/2476] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:46.311641 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.312011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.312347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.344739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:46.344739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:46.352080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1233/2477] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:46.353247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.365279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbfdd-7c56-4166-977f-8a613f163b58 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.371627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.372335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.372687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.373038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.373780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:06:46.374156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.375929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.407999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1245/2478] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:06:46.409541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.414353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:46.423258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78d87-75c8-4993-b33c-7c01b8c29f00 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.429828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.429828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.429828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.429828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.430251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.432114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.604341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1234/2479] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:06:46 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:46.609130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.619125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a091f0-0e57-4770-8132-2c37c5a4a5ab admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.679954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.680487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.680850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.681137 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.681769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.684309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.810001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1246/2480] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:06:46 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:46.814359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.828426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efacd-2a70-4858-886c-36239cf19e05 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.834325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.835159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.835517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.835861 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.836512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.838147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.854780 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1235/2481] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:06:46.856811 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.867959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fd22-c485-43c9-b9f2-51ddeb1caf88 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.878467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.879101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.879364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.879724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.880270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.881872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aae31-ec95-4122-bb5e-873b37a2a3a1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.899644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1247/2482] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:06:46.901587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:46.913645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f130c-c1f5-42cc-a9e9-f1df7bba74ad admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:46.919070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:46.919732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:46.920005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:46.920268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] PATH_INFO: `/v3/projects/c42a2e7e8f93430c98780710b9d30d79/users/2266b828f0394940b62247030ae72537/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:46.938562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a2e7e8f93430c98780710b9d30d79, user_id=2266b828f0394940b62247030ae72537, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:46.941380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:46.998983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1236/2483] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:06:46 2022] PUT /identity/v3/projects/c42a2e7e8f93430c98780710b9d30d79/users/2266b828f0394940b62247030ae72537/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:47.009622 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd170c4-02d6-4585-8063-bad94c451b86 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:47.010183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd170c4-02d6-4585-8063-bad94c451b86 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:47.010810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd170c4-02d6-4585-8063-bad94c451b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:47.046574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2fd170c4-02d6-4585-8063-bad94c451b86 None None] MFA Rules not processed for user `2266b828f0394940b62247030ae72537`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:47.047819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2fd170c4-02d6-4585-8063-bad94c451b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:47.146373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1248/2484] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:47.165870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:47.167577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:47.233008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e9b4d-b9b6-42a9-b03b-0792358676c5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:47.237723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:47.238445 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:47.238847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:47.239193 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:47.253031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:47.259437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c65a-d780-4838-9e0e-69213a38f92a service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:47.268134 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1237/2485] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:49.180259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e9a1-1f21-4a25-8e6a-3ac47456f4dd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:49.180989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e9a1-1f21-4a25-8e6a-3ac47456f4dd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:49.180989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e9a1-1f21-4a25-8e6a-3ac47456f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:49.201321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8e03e9a1-1f21-4a25-8e6a-3ac47456f4dd None None] MFA Rules not processed for user `2266b828f0394940b62247030ae72537`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:49.202855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8e03e9a1-1f21-4a25-8e6a-3ac47456f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:49.210504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1249/2486] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:50.613000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ee7-2c70-4e7d-b515-f6f0e9928a81 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:50.613522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ee7-2c70-4e7d-b515-f6f0e9928a81 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:50.613945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368ee7-2c70-4e7d-b515-f6f0e9928a81 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:50.616419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1238/2487] 10.222.0.58 () {54 vars in 961 bytes} [Thu Sep 1 18:06:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:06:50.621804 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf04a3-4644-44a8-84a8-1e316af75639 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:50.622283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf04a3-4644-44a8-84a8-1e316af75639 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:50.622407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf04a3-4644-44a8-84a8-1e316af75639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:50.631186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:50.642256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-cfcf04a3-4644-44a8-84a8-1e316af75639 None None] MFA Rules not processed for user `90fb57878f024c05bdc9166eea624e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:50.647675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cfcf04a3-4644-44a8-84a8-1e316af75639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:50.708644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1250/2488] 10.222.0.58 () {58 vars in 1058 bytes} [Thu Sep 1 18:06:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:50.719011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368ee7-2c70-4e7d-b515-f6f0e9928a81 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:50.733429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368ee7-2c70-4e7d-b515-f6f0e9928a81 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:50.739751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:50.739751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:50.739751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:50.741334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:50.742747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:50.756812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:50.767454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:50.769808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1239/2489] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:51.899734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9a78-1c6d-4718-916b-72885dc79d0c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:51.900220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9a78-1c6d-4718-916b-72885dc79d0c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:51.900633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9a78-1c6d-4718-916b-72885dc79d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:51.922016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b09e9a78-1c6d-4718-916b-72885dc79d0c None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:51.923284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b09e9a78-1c6d-4718-916b-72885dc79d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:51.981236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1251/2490] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:06:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:51.996581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:51.997815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:52.069158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39224-10af-4147-ac2e-717556dcdbce service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:52.075346 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:52.075953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:52.076230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:52.076503 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:52.086797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:52.088476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:52.098474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1240/2491] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:06:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:06:53.587825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:53.588363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:53.588363 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:53.610152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:53.611417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:53.675658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1252/2492] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:53.695611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:53.695611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:53.733339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:53.786355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930a01d-9877-46f6-b805-9c6e28d2cb5c service swift] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:53.792580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:53.793184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:53.796542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:53.796542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:53.802311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:53.803954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:53.814635 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1241/2493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:55.787196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:55.788841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:55.804050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4826f-55e8-4a6d-a9ca-2dd558acb610 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:55.810088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:55.810848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:55.811255 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:55.811417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] PATH_INFO: `/v3/users/9e9d73e445d24516a0a85bf897203564` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:55.812657 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9d73e445d24516a0a85bf897203564)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:55.814581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:56.085927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:56.092275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9d73e445d24516a0a85bf897203564'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.099289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9d73e445d24516a0a85bf897203564'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.201991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9d73e445d24516a0a85bf897203564'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.205501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9d73e445d24516a0a85bf897203564'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.219903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4527ed46-5710-40ee-9331-628f0cab5cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9d73e445d24516a0a85bf897203564'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.225792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1253/2494] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:06:55 2022] DELETE /identity/v3/users/9e9d73e445d24516a0a85bf897203564 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:56.477617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:56.488932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5049-23d4-46f7-a235-3807b7000e23 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:56.548957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:56.549630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:56.549916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:56.550187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] PATH_INFO: `/v3/projects/a22dc4b84c264c708aa976a7ef06113d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:56.551343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22dc4b84c264c708aa976a7ef06113d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:56.553276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:56.709708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22dc4b84c264c708aa976a7ef06113d', 'request_id': 'req-68252181-708e-406a-b1d4-af33fb30233a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.716269 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22dc4b84c264c708aa976a7ef06113d', 'request_id': 'req-68252181-708e-406a-b1d4-af33fb30233a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.779574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22dc4b84c264c708aa976a7ef06113d', 'request_id': 'req-68252181-708e-406a-b1d4-af33fb30233a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.791671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] The token cache is being invalidate because project a22dc4b84c264c708aa976a7ef06113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:06:56.791968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.794161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-68252181-708e-406a-b1d4-af33fb30233a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:06:56.795760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1242/2495] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:06:56 2022] DELETE /identity/v3/projects/a22dc4b84c264c708aa976a7ef06113d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:56.800737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:56.801301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:56.801402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:56.830232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:56.831519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:56.893778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1254/2496] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:06:56.901850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:56.902118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:56.902488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:56.923250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:56.924451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:56.932364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1243/2497] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:56.937220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:56.946977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf80c6-8ace-47f7-ad5f-a155f4bb4dcd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:56.952570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:56.953167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:56.953448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:56.953719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:56.954360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:06:56.954661 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:56.956723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:56.968805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1255/2498] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:06:56.973242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:56.982540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d353d-dd55-4b58-93a7-cac663079918 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:56.987270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:56.987866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:56.988139 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:56.988403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:56.989035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:56.990976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.107377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1244/2499] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:06:56 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:57.111629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:57.122065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608d3d-66b4-4e1e-af38-1d97685cbc32 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:57.176260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:57.176852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.177126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.177393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.178034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:57.179968 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.272750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1256/2500] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:06:57 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:06:57.293036 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:57.303644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63667c0d-38ff-443e-9d70-c6c85e733e62 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:57.309028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:57.314831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.314831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.314831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.314831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:57.314831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.318474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:57.323843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1245/2501] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:06:57.328065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:57.338065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86b5f-7022-4ed6-8407-5507392addc9 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:57.342802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:57.343400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.343660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.343933 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.344578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:57.346198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fbc49-9d32-466b-8852-912264af0da5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.357573 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1257/2502] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:06:57.361605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:57.372315 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574836b-7ec4-4880-9f76-678fb7bef4a1 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:57.377762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:57.378749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.379165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.379562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] PATH_INFO: `/v3/projects/3f9ce089a1ea4e949dd867d24b68b457/users/49c63c5624a34ac5987b54e4edbf55c1/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.399092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ce089a1ea4e949dd867d24b68b457, user_id=49c63c5624a34ac5987b54e4edbf55c1, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:57.402211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.506404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1246/2503] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:06:57 2022] PUT /identity/v3/projects/3f9ce089a1ea4e949dd867d24b68b457/users/49c63c5624a34ac5987b54e4edbf55c1/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:06:57.516903 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d5b86-888d-4057-b6fb-a0b3db028409 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.517192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d5b86-888d-4057-b6fb-a0b3db028409 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.517470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d5b86-888d-4057-b6fb-a0b3db028409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.545939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a70d5b86-888d-4057-b6fb-a0b3db028409 None None] MFA Rules not processed for user `49c63c5624a34ac5987b54e4edbf55c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:57.547218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a70d5b86-888d-4057-b6fb-a0b3db028409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:57.559837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:57.612915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1258/2504] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:06:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:57.627300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:57.629470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:57.691518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae2b6-e203-43dc-b595-20012382a7eb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:57.695188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:57.695787 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:57.696067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:57.696337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:57.705852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:57.707389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:57.718293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1247/2505] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:06:58.104460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e122f-fc22-4305-9c2b-7a6d0214949d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:58.105025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e122f-fc22-4305-9c2b-7a6d0214949d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:58.105149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e122f-fc22-4305-9c2b-7a6d0214949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:58.125654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a78e122f-fc22-4305-9c2b-7a6d0214949d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:06:58.126951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a78e122f-fc22-4305-9c2b-7a6d0214949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:58.187967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1259/2506] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:06:58.207177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:06:58.208591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:06:58.282166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271be9b0-2c20-40c1-8695-8e1e4e95466c service glance] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:06:58.287724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:06:58.288323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:06:58.288600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:06:58.288868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:06:58.297105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:06:58.298811 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:06:58.308588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1248/2507] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:03.014512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e9a1-d9ff-49f0-b409-95d579b3f1f7 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:03.015026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e9a1-d9ff-49f0-b409-95d579b3f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:03.015951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e9a1-d9ff-49f0-b409-95d579b3f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:03.041931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-19f1e9a1-d9ff-49f0-b409-95d579b3f1f7 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:03.043730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-19f1e9a1-d9ff-49f0-b409-95d579b3f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:03.051590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1260/2508] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:03.069070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:03.082308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0228-7589-4261-a5bd-e548c44e63e2 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:03.087986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:03.088584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:03.088864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:03.089707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:03.098904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:03.100500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:03.110624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1249/2509] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:10.458861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763aaf1-6dde-4148-8ea7-acd3df27b68f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:10.459429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763aaf1-6dde-4148-8ea7-acd3df27b68f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:10.459429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763aaf1-6dde-4148-8ea7-acd3df27b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:10.479963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f763aaf1-6dde-4148-8ea7-acd3df27b68f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:10.481170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f763aaf1-6dde-4148-8ea7-acd3df27b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:10.489882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1261/2510] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:10.519424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:10.520969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:10.537033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714dad-8647-4f40-9a6d-dd19c140e539 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:10.544135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:10.544735 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:10.545901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:10.546274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:10.554829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:10.556508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:10.565951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1250/2511] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:11.141128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421dab7-8b3e-4ad0-9257-f519311b5ee3 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:11.141420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421dab7-8b3e-4ad0-9257-f519311b5ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:11.141695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421dab7-8b3e-4ad0-9257-f519311b5ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:11.161686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-9421dab7-8b3e-4ad0-9257-f519311b5ee3 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:11.163036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-9421dab7-8b3e-4ad0-9257-f519311b5ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:11.221497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1262/2512] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:11.234367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:11.236299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:11.278381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:11.305616 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1fb29-c406-4994-8df5-58897cebae51 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:11.310667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:11.315083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:11.315083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:11.315083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:11.319886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:11.321453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:11.329550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1251/2513] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 18:07:12.403302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77133-da64-4551-9d30-f45d829c6d6a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:12.403753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77133-da64-4551-9d30-f45d829c6d6a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:12.403858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77133-da64-4551-9d30-f45d829c6d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:12.423490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c5f77133-da64-4551-9d30-f45d829c6d6a None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:12.424672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c5f77133-da64-4551-9d30-f45d829c6d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:12.431852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1263/2514] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:12.445038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:12.456868 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d4-39d1-45d4-870d-10dc6af18d01 service swift] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:12.462348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:12.463061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:12.463344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:12.463617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:12.472456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:12.474031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:12.484216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1252/2515] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:07:13.179073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ae48-fcde-41b2-8ae9-df97d2a5bc57 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.179352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ae48-fcde-41b2-8ae9-df97d2a5bc57 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.179655 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ae48-fcde-41b2-8ae9-df97d2a5bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.199107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8683ae48-fcde-41b2-8ae9-df97d2a5bc57 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:13.200553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8683ae48-fcde-41b2-8ae9-df97d2a5bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:13.209261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1264/2516] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:13.222069 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:13.234130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d349f3-6644-42af-b82a-f0fc03e52fb3 service swift] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:13.240377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:13.241145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.241424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.241694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.251130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:13.252707 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:13.261436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1253/2517] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:07:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:07:13.741233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70526-048c-42bf-8068-0f108d2f2a55 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.741736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70526-048c-42bf-8068-0f108d2f2a55 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.741872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa70526-048c-42bf-8068-0f108d2f2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.762927 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6aa70526-048c-42bf-8068-0f108d2f2a55 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:13.764178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6aa70526-048c-42bf-8068-0f108d2f2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:13.773740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1265/2518] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:13.802117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:13.816371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3b4e1-c635-4a3f-9863-2f828f993867 service swift] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:13.822467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45be628-d326-4830-8f93-7db83656feef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:13.823164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be628-d326-4830-8f93-7db83656feef service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.823509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be628-d326-4830-8f93-7db83656feef service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.823844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be628-d326-4830-8f93-7db83656feef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.833772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45be628-d326-4830-8f93-7db83656feef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:13.835436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45be628-d326-4830-8f93-7db83656feef service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:13.846103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1254/2519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:13.874306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.877073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.877365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.898216 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:13.899460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:13.907239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1266/2520] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:13.919536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45be628-d326-4830-8f93-7db83656feef service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:13.932887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45be628-d326-4830-8f93-7db83656feef service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:13.939239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:13.939928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:13.940283 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:13.940626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:13.950614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:13.952902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a90b-245c-4a88-9f30-8234f0601913 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:13.966177 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1255/2521] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:07:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:07:16.756448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:16.756448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:16.770180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f26bc-a588-41f1-aabb-b4331cac3d30 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:16.775621 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:16.776372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:16.776753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:16.777322 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] PATH_INFO: `/v3/users/2266b828f0394940b62247030ae72537` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:16.779227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2266b828f0394940b62247030ae72537)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:16.781130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:16.805905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:17.011026 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2266b828f0394940b62247030ae72537'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.018771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2266b828f0394940b62247030ae72537'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.088006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2266b828f0394940b62247030ae72537'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.088636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2266b828f0394940b62247030ae72537'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.102564 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2266b828f0394940b62247030ae72537'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.108656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1267/2522] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:07:16 2022] DELETE /identity/v3/users/2266b828f0394940b62247030ae72537 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:17.113871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:17.114360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:17.114486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:17.134018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:17.135278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:17.194284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1256/2523] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:17.204329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:17.205706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:17.265309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418bc00-a169-4e7a-8018-241558260976 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:17.269171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:17.269832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:17.275630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:17.275630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:17.279805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:17.281809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491ada-86f5-41e6-8942-9bbe63c6b7bb service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:17.291553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1268/2524] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:17.598751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:17.600289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:17.614348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dc2a-3a7a-49ee-bf87-c973cc0bde78 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:17.619541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:17.620200 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:17.620648 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:17.620917 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] PATH_INFO: `/v3/projects/c42a2e7e8f93430c98780710b9d30d79` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:17.622050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42a2e7e8f93430c98780710b9d30d79)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:17.623989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:17.729682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42a2e7e8f93430c98780710b9d30d79', 'request_id': 'req-fe8c6817-51d6-4198-aa54-822ad92ee303'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.738830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42a2e7e8f93430c98780710b9d30d79', 'request_id': 'req-fe8c6817-51d6-4198-aa54-822ad92ee303'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.818952 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42a2e7e8f93430c98780710b9d30d79', 'request_id': 'req-fe8c6817-51d6-4198-aa54-822ad92ee303'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.826608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:17.832048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] The token cache is being invalidate because project c42a2e7e8f93430c98780710b9d30d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:07:17.832336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.832981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-fe8c6817-51d6-4198-aa54-822ad92ee303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:17.834455 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1257/2525] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:07:17 2022] DELETE /identity/v3/projects/c42a2e7e8f93430c98780710b9d30d79 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:17.839588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:17.840143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:17.840235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:17.862130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:17.862416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:17.925763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1269/2526] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:17.933805 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:17.934088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:17.934358 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:17.960736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:17.961911 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:17.981578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1258/2527] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:17.986440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:17.996578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26b90a-05b8-432c-9ff8-4459e27ef39f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.002308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.002944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.003223 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.003496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.004142 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:07:18.004446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.006112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.019805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1270/2528] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:07:18.023957 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.036089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12031a10-6c73-45cd-90a8-997d5cc4a4c9 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.047154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.047829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.048106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.048375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.049020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.051002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.169601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1259/2529] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:07:18 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:07:18.177248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.187330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca6e4-d279-4d32-a182-d82b90a11896 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.207781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:18.245284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.245883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.246158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.246424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.247099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.249011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.352156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1271/2530] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:07:18 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:07:18.356192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.367042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfff4-b107-48b2-ab33-dbd8373725d4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.372039 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.372689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.372914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.373186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.373815 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.376178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.386741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1260/2531] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:07:18.391625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.401704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3eaf-ab4b-47f8-bade-7b73e74beb32 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.406755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.418987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.418987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.418987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.418987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.418987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21def-b89c-42ef-8361-54e9724a7333 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.421818 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1272/2532] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:07:18.426539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.439178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd25e0-1bd7-41f2-81c3-10c04ee0ab4b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.443855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.445441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.445441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.445441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] PATH_INFO: `/v3/projects/37df46d4304f4df8bba326275287331e/users/733d71128e3a41ad82357ed0b4d7d7b8/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.460462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37df46d4304f4df8bba326275287331e, user_id=733d71128e3a41ad82357ed0b4d7d7b8, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.463141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.540435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1261/2533] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:07:18 2022] PUT /identity/v3/projects/37df46d4304f4df8bba326275287331e/users/733d71128e3a41ad82357ed0b4d7d7b8/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:18.611593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.611944 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.612151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.648919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] MFA Rules not processed for user `733d71128e3a41ad82357ed0b4d7d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:18.650073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:18.719959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1273/2534] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:18.730988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:18.733393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:18.801420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77fbe7-b875-4a2a-8fa7-595f9123ae23 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:18.805093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:18.805726 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:18.806004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:18.806259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:18.819504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:18.820989 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a058-25a6-4a9e-b32a-d73e93fd7747 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:18.834049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1262/2535] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:24.625654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:24.627836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:24.696178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db7ac7-ad62-4f76-85b1-cf5d35826e19 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:24.700841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:24.701458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:24.701736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:24.702002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] PATH_INFO: `/v3/users/49c63c5624a34ac5987b54e4edbf55c1` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:24.703416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c63c5624a34ac5987b54e4edbf55c1)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:24.705378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:24.924962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:24.936905 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c63c5624a34ac5987b54e4edbf55c1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:24.944689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c63c5624a34ac5987b54e4edbf55c1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:25.055333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c63c5624a34ac5987b54e4edbf55c1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:25.056468 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c63c5624a34ac5987b54e4edbf55c1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:25.071138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c63c5624a34ac5987b54e4edbf55c1'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:25.077145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1274/2536] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:07:24 2022] DELETE /identity/v3/users/49c63c5624a34ac5987b54e4edbf55c1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:25.082003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:25.082520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:25.082520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:25.101526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:25.102712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:25.169980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1263/2537] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:25.180597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:25.182071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:25.253445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adbe4-e980-4189-bd4b-e7497c4752a7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:25.257986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:25.258600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:25.258918 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:25.259191 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:25.268973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:25.272812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:25.284815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1275/2538] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:25.746223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:25.756519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:25.775386 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b542-9648-44d8-860e-cd376e7c13d8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:25.783376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:25.790512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:25.796187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:25.796466 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] PATH_INFO: `/v3/projects/3f9ce089a1ea4e949dd867d24b68b457` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:25.799927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9ce089a1ea4e949dd867d24b68b457)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:25.802061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:25.962326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:25.974812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9ce089a1ea4e949dd867d24b68b457', 'request_id': 'req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:25.980497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9ce089a1ea4e949dd867d24b68b457', 'request_id': 'req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:26.088236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9ce089a1ea4e949dd867d24b68b457', 'request_id': 'req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:26.100267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] The token cache is being invalidate because project 3f9ce089a1ea4e949dd867d24b68b457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:07:26.100553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:26.101184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-bb7c87df-ca2e-4fb4-98c0-baa39ffbe75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:26.102766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1264/2539] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:07:25 2022] DELETE /identity/v3/projects/3f9ce089a1ea4e949dd867d24b68b457 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:30.939289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:30.940929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:30.954077 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd303-c36c-4fcf-849d-3724691e49b7 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:31.015421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:31.016044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:31.016320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:31.016589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] PATH_INFO: `/v3/users/733d71128e3a41ad82357ed0b4d7d7b8` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:31.017687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=733d71128e3a41ad82357ed0b4d7d7b8)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:31.020147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:31.257886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733d71128e3a41ad82357ed0b4d7d7b8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:31.264030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:31.266050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733d71128e3a41ad82357ed0b4d7d7b8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:31.322236 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733d71128e3a41ad82357ed0b4d7d7b8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:31.322979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733d71128e3a41ad82357ed0b4d7d7b8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:31.336873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733d71128e3a41ad82357ed0b4d7d7b8'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:31.343031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1276/2540] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:07:30 2022] DELETE /identity/v3/users/733d71128e3a41ad82357ed0b4d7d7b8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:31.347605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7eb68-91a7-4574-b62e-0ec62c6c3bb1 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:31.348131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7eb68-91a7-4574-b62e-0ec62c6c3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:31.348131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7eb68-91a7-4574-b62e-0ec62c6c3bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:31.367062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-a7b7eb68-91a7-4574-b62e-0ec62c6c3bb1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:31.368271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a7b7eb68-91a7-4574-b62e-0ec62c6c3bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:31.430228 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1265/2541] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:31.439923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:31.441985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:31.443012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:31.443403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:31.443775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:31.463454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] MFA Rules not processed for user `be32a4ec9c25448a9467a807e75b6dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:31.464713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:31.503756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c96e-d39d-43e8-aad4-0647dfeacacf admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:31.507925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:31.508865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:31.509155 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:31.509429 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:31.519579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:31.521153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998eee0-7940-46ab-81bd-94f88575d068 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:31.522359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1266/2542] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:07:31.531032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1277/2543] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:32.192986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:32.194678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:32.212027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8645-f47d-4c50-921f-7d52e03f7cbc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:32.217289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:32.217915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:32.218288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:32.218554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] PATH_INFO: `/v3/projects/37df46d4304f4df8bba326275287331e` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:32.219718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] RBAC: Authorizing `identity:delete_project(project_id=37df46d4304f4df8bba326275287331e)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:32.224491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:32.326608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37df46d4304f4df8bba326275287331e', 'request_id': 'req-2ac81dfe-950c-4fa2-a158-0851b0c120db'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:32.334800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37df46d4304f4df8bba326275287331e', 'request_id': 'req-2ac81dfe-950c-4fa2-a158-0851b0c120db'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:32.337627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:32.431486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37df46d4304f4df8bba326275287331e', 'request_id': 'req-2ac81dfe-950c-4fa2-a158-0851b0c120db'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:32.446686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] The token cache is being invalidate because project 37df46d4304f4df8bba326275287331e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:07:32.447019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:32.447674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2ac81dfe-950c-4fa2-a158-0851b0c120db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:07:32.449392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1267/2544] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:07:32 2022] DELETE /identity/v3/projects/37df46d4304f4df8bba326275287331e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:07:33.026846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:33.027384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:33.027384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:33.048269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] MFA Rules not processed for user `4bc63726077349f3bb728041975fecba`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:33.049480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:33.104130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1278/2545] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:07:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:42.484704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=1,keystone:SELECT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:43.097361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=60,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:50.394278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006e7b-e4e9-463c-8575-da03f14cf298 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:50.395033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006e7b-e4e9-463c-8575-da03f14cf298 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:50.395033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006e7b-e4e9-463c-8575-da03f14cf298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:50.415803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9a006e7b-e4e9-463c-8575-da03f14cf298 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:50.417097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9a006e7b-e4e9-463c-8575-da03f14cf298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:50.477093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1268/2546] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:50.490957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:50.492373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:50.566098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eea39-9f14-4bf5-b123-9d918367a010 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:50.572195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:50.572801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:50.573078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:50.573348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:50.582441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:50.584119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:50.593681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1279/2547] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:54.073788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516d77-0509-4c2e-a526-74bb37017c19 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:54.074256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516d77-0509-4c2e-a526-74bb37017c19 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:54.074256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78516d77-0509-4c2e-a526-74bb37017c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:54.094248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-78516d77-0509-4c2e-a526-74bb37017c19 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:54.096055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-78516d77-0509-4c2e-a526-74bb37017c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:54.104068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1269/2548] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:54.129244 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:54.130807 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:54.148360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b535de-ac70-413d-8014-74ba35c2403b service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:54.154775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:54.155368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:54.155648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:54.155916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:54.164511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:54.166082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:54.176273 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1280/2549] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:07:56.897845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4e77-71b4-4582-ad3e-79b5d4133abe None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:56.898326 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4e77-71b4-4582-ad3e-79b5d4133abe None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:56.898444 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4e77-71b4-4582-ad3e-79b5d4133abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:56.918235 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9dff4e77-71b4-4582-ad3e-79b5d4133abe None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:07:56.919484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9dff4e77-71b4-4582-ad3e-79b5d4133abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:07:56.927364 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1270/2550] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:07:56.950123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:07:56.963113 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839cea-b03b-4fff-9980-f981a628e1d3 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:07:56.968647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:07:56.969261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:07:56.969536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:07:56.969805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:07:56.978623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:07:56.980227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:07:56.990439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1281/2551] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:00.176896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a29e9-bdb9-45c1-95fe-7821520804a0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:00.177408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a29e9-bdb9-45c1-95fe-7821520804a0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:00.177720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a29e9-bdb9-45c1-95fe-7821520804a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:00.199532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-908a29e9-bdb9-45c1-95fe-7821520804a0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:00.201052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-908a29e9-bdb9-45c1-95fe-7821520804a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:00.212002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1271/2552] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:00.227609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:00.240643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abb6c3-6122-4dad-a749-42dd51d587e5 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:00.258632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:00.261073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:00.261837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:00.266042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:00.278893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:00.284229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:00.298426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1282/2553] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:03.448975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f88ad-b6f6-4981-84f2-6607de955d35 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:03.449480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f88ad-b6f6-4981-84f2-6607de955d35 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:03.450793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f88ad-b6f6-4981-84f2-6607de955d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:03.470298 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1a8f88ad-b6f6-4981-84f2-6607de955d35 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:03.471599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1a8f88ad-b6f6-4981-84f2-6607de955d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:03.484440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1272/2554] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Sep 1 18:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:03.500380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:03.511976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a650-eadf-46cb-a13a-c037f7fdeb13 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:03.517460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:03.518053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:03.518325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:03.518591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:03.526872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:03.528425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:03.538105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1283/2555] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:08:11.011494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:11.011978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:11.012099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:11.031686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:11.032881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:11.087338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1273/2556] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:11.109940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:11.111465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:11.179537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cc1-a9db-4841-8191-ba47492778ed service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:11.184411 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:11.185003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:11.185278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:11.185545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:11.193329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:11.195646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:11.203409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1284/2557] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:08:20.719082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:20.720664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:20.732883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=65 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:20.740083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d777705-abf8-4342-bb65-9fc023cfc651 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:20.746027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:20.746742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:20.747033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:20.747305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] PATH_INFO: `/v3/users/14caeeea3623495c87977ea71af4aad7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:20.749138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14caeeea3623495c87977ea71af4aad7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:20.751123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:21.015117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14caeeea3623495c87977ea71af4aad7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.024500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14caeeea3623495c87977ea71af4aad7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.099496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14caeeea3623495c87977ea71af4aad7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.113238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14caeeea3623495c87977ea71af4aad7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.113914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14caeeea3623495c87977ea71af4aad7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.120690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1274/2558] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:08:20 2022] DELETE /identity/v3/users/14caeeea3623495c87977ea71af4aad7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:21.200282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:21.445879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:21.452963 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626e61-57b6-4a8d-abc9-0eab60253d0b service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:21.515152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:21.515794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:21.516072 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:21.516344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] PATH_INFO: `/v3/projects/ecb9e054d21e43db93473ca04e688c29` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:21.517502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb9e054d21e43db93473ca04e688c29)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:21.519556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:21.685040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb9e054d21e43db93473ca04e688c29', 'request_id': 'req-ddd1bd04-a123-492d-abc5-e9db6e03efba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.691269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb9e054d21e43db93473ca04e688c29', 'request_id': 'req-ddd1bd04-a123-492d-abc5-e9db6e03efba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.698596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb9e054d21e43db93473ca04e688c29', 'request_id': 'req-ddd1bd04-a123-492d-abc5-e9db6e03efba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.831066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] The token cache is being invalidate because project ecb9e054d21e43db93473ca04e688c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:08:21.831602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.832423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:21.834652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1285/2559] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:08:21 2022] DELETE /identity/v3/projects/ecb9e054d21e43db93473ca04e688c29 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:21.838417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:21.840201 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:21.854237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863f24-bdb4-4810-b8eb-89bfeb519b3a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:21.942414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:21.943248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:21.943592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:21.944679 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] PATH_INFO: `/v3/users/86c509ad478b4897bb1a37e43f2e09f7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:21.945840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c509ad478b4897bb1a37e43f2e09f7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:21.947962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:22.112146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c509ad478b4897bb1a37e43f2e09f7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.119747 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c509ad478b4897bb1a37e43f2e09f7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.211939 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c509ad478b4897bb1a37e43f2e09f7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.222610 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:22.224710 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c509ad478b4897bb1a37e43f2e09f7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.225978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5cf7347b-e415-4829-adb7-7d2ce45fc941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c509ad478b4897bb1a37e43f2e09f7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.231783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1275/2560] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:08:21 2022] DELETE /identity/v3/users/86c509ad478b4897bb1a37e43f2e09f7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:22.581336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:22.583433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:22.599409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1bd04-a123-492d-abc5-e9db6e03efba admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:22.658891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:22.659581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:22.659855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:22.660124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] PATH_INFO: `/v3/projects/816ee1e1aba54d30971685b18ff7b3e0` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:22.661256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816ee1e1aba54d30971685b18ff7b3e0)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:22.663972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:22.795550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:22.807690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816ee1e1aba54d30971685b18ff7b3e0', 'request_id': 'req-8079f51b-a783-4d22-939e-96d744aeed24'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.813759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816ee1e1aba54d30971685b18ff7b3e0', 'request_id': 'req-8079f51b-a783-4d22-939e-96d744aeed24'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.820267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816ee1e1aba54d30971685b18ff7b3e0', 'request_id': 'req-8079f51b-a783-4d22-939e-96d744aeed24'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.887771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] The token cache is being invalidate because project 816ee1e1aba54d30971685b18ff7b3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:08:22.887989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.888615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-8079f51b-a783-4d22-939e-96d744aeed24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:22.890248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1286/2561] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:08:22 2022] DELETE /identity/v3/projects/816ee1e1aba54d30971685b18ff7b3e0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:22.895212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:22.895736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:22.897843 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:22.917983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:22.919209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:22.989807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1276/2562] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:22.998678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:22.999328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:22.999614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.026105 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:23.027731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:23.036913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1287/2563] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:08:23.041210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.055701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0cb0-a4e1-4af5-8af3-44284d09c2dc None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.060867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.061539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.061849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.062123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.062874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:08:23.063185 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.064914 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.078662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1277/2564] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:08:23.083679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.093743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5152-0706-4d7c-a28f-596d86b5625e None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.098983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.099586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.099864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.100166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.100810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.102763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.226939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1288/2565] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:08:23 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:08:23.231017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.241581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b633b-1612-4cfc-b104-2ddf9056d166 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.302695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.303974 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.304305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.304578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.305226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.307168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.401264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1278/2566] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:08:23 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:08:23.405813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.417412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdddfe-8064-4fd3-99c4-1b3f57263dc3 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.422972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.423559 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.423834 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.424104 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.424743 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.426781 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.438219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1289/2567] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:23.442164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.452926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245ba9-73c2-4f44-9083-299370babe6f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.457803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.458388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.458662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.458960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.459643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.461227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa8c7-8c56-4232-b928-c6057a720dd1 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.471932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1279/2568] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:23.475989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.486040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af396-6c11-4047-8d1d-465c8c5f624d admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.491376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.492152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.492437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.492711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] PATH_INFO: `/v3/projects/c678ef12fdc247d5b790d5af20481426/users/616f058252c4486eb29f3d89857f15cd/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.508796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c678ef12fdc247d5b790d5af20481426, user_id=616f058252c4486eb29f3d89857f15cd, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.511431 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.635605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1290/2569] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:08:23 2022] PUT /identity/v3/projects/c678ef12fdc247d5b790d5af20481426/users/616f058252c4486eb29f3d89857f15cd/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:23.640837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d212e3-5efb-4790-b06f-965f05ec34c0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.641232 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d212e3-5efb-4790-b06f-965f05ec34c0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.642081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d212e3-5efb-4790-b06f-965f05ec34c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.663632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-93d212e3-5efb-4790-b06f-965f05ec34c0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:23.664996 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-93d212e3-5efb-4790-b06f-965f05ec34c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:23.717049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:23.725950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1280/2570] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:23.735992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:23.737761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:23.797999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165a093-3ce9-4254-9f18-053480fe3954 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:23.801711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:23.802455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:23.802700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:23.802996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:23.812609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:23.814023 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:23.824893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1291/2571] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:31.006070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.006070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.006070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.039955 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] MFA Rules not processed for user `616f058252c4486eb29f3d89857f15cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:31.041318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:31.139992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1281/2572] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:31.144836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.156637 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9257bc4-d37e-4bbc-99e6-5ef47fdee25b service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.171201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.172069 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.172606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.173111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.174568 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.177376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.323486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1292/2573] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:08:31 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:08:31.324602 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.337605 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e4d12-274f-4031-9856-c9434059a039 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.434709 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.435409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.435693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.436016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.436693 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.439918 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.588088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1282/2574] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:08:31 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:08:31.589679 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.600317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece09b6-c4f8-4697-b85d-b175ac6fa26f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.604878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.605474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.606057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.606333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.607011 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.608624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.621390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1293/2575] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:31.636349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.649580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8bcd5-ad40-4208-9e2e-88cf6791e810 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.657334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.658020 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.658302 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.658572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] PATH_INFO: `/v3/projects/7cf2ddf895fa468aa96cc83b3158c976/users/f7b7136a987e4b93a5d176c2b00ead1c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.675336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2ddf895fa468aa96cc83b3158c976, user_id=f7b7136a987e4b93a5d176c2b00ead1c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.678696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.798825 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1283/2576] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:08:31 2022] PUT /identity/v3/projects/7cf2ddf895fa468aa96cc83b3158c976/users/f7b7136a987e4b93a5d176c2b00ead1c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:31.803055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.815197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428fab-73d6-49f6-9d12-26650f457d93 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.845454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:31.902283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.902940 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.903222 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.903495 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.904160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.905740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295529-bcbe-49e8-9311-64bf5fbe638b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.920033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1294/2577] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:31.924278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:31.937518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb22e-fc3a-4374-b7cf-ad10ff6b0dee admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:31.942760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:31.943494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:31.943801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:31.944103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] PATH_INFO: `/v3/projects/7cf2ddf895fa468aa96cc83b3158c976/users/f7b7136a987e4b93a5d176c2b00ead1c/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:31.946160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2ddf895fa468aa96cc83b3158c976, user_id=f7b7136a987e4b93a5d176c2b00ead1c, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:31.948921 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4269ff9-63f1-48f9-a2d5-53c02fc0a431 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:31.961047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1284/2578] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:08:31 2022] PUT /identity/v3/projects/7cf2ddf895fa468aa96cc83b3158c976/users/f7b7136a987e4b93a5d176c2b00ead1c/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:08:34.980633 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:34.981118 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:34.982053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:35.031515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] MFA Rules not processed for user `0fc9a7bfd2dc48a6ab96957b23b45eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:35.032760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:35.148167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1295/2579] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:39.335712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:39.341632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:39.341632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:39.383784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] MFA Rules not processed for user `f7b7136a987e4b93a5d176c2b00ead1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:39.386601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:39.422254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:39.479708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1285/2580] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:39.480014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:39.481648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:39.576613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19811e3b-7624-41a3-a883-518e0baa9d7a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:39.582702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:39.583664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:39.584007 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:39.585043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:39.657993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:39.659800 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:39.670141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1296/2581] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:40.527048 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:40.528636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:40.611926 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433408-4e84-49ee-9f3c-74c17340158b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:40.616767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:40.617402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:40.617711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:40.618071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] PATH_INFO: `/v3/users/be32a4ec9c25448a9467a807e75b6dca` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:40.619394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be32a4ec9c25448a9467a807e75b6dca)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:40.621355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:40.904396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be32a4ec9c25448a9467a807e75b6dca'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:40.915449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be32a4ec9c25448a9467a807e75b6dca'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:40.996116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:40.998985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:41.007164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:41.029109 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be32a4ec9c25448a9467a807e75b6dca'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.051412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be32a4ec9c25448a9467a807e75b6dca'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.052541 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be32a4ec9c25448a9467a807e75b6dca'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.063521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1286/2582] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:08:40 2022] DELETE /identity/v3/users/be32a4ec9c25448a9467a807e75b6dca => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:41.075883 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53ddfe-073b-40ad-aee5-60c242829ab7 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:41.134954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:41.135941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:41.136370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:41.136785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:41.138902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:41.235485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:41.237065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:41.251096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1297/2583] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:41.529297 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:41.533377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:41.611532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:41.627359 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b703b-663f-437e-b31d-85f0264603f5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:41.632519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:41.633168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:41.633460 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:41.633706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] PATH_INFO: `/v3/projects/3b283f0ca16f4e8a975812f81a9deecc` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:41.634992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b283f0ca16f4e8a975812f81a9deecc)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:41.636958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:41.806988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b283f0ca16f4e8a975812f81a9deecc', 'request_id': 'req-74f086d8-956f-4302-b377-3a31c64cd87e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.813736 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b283f0ca16f4e8a975812f81a9deecc', 'request_id': 'req-74f086d8-956f-4302-b377-3a31c64cd87e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.971881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b283f0ca16f4e8a975812f81a9deecc', 'request_id': 'req-74f086d8-956f-4302-b377-3a31c64cd87e'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.983947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] The token cache is being invalidate because project 3b283f0ca16f4e8a975812f81a9deecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:08:41.984241 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.984882 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-74f086d8-956f-4302-b377-3a31c64cd87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:41.986372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1287/2584] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:08:41 2022] DELETE /identity/v3/projects/3b283f0ca16f4e8a975812f81a9deecc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:42.526400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:42.527962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:42.539420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aae84-4060-4f92-8a06-ab25f4f90e98 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:42.588264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:42.588866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:42.589194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:42.589473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:42.591353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:42.605803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:42.668583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:42.670211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:42.683879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1298/2585] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:43.024916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:43.025468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:43.025468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:43.048695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] MFA Rules not processed for user `616f058252c4486eb29f3d89857f15cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:43.052671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:43.108429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1288/2586] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:47.948192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:47.949764 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:47.962038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c33-07e8-4c52-9d26-b6dd779a1177 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:47.965814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:47.966449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:47.967199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:47.967199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:47.968753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:48.047398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:48.049062 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:48.060389 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1299/2587] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:52.070704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:52.072208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:52.169182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f6a9b-be9a-4883-a691-6b7f6329f10d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:52.174792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:52.176308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:52.180902 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:52.181385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:52.185175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:52.199849 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:52.201448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:52.217249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1289/2588] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:52.279124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:52.280593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:52.299451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792961e-3cec-44bd-8a4b-99039bcf099c service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:52.299451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:52.299451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:52.299451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:52.299886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] PATH_INFO: `/v3/users/4bc63726077349f3bb728041975fecba` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:52.300502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc63726077349f3bb728041975fecba)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:52.302483 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:52.557235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc63726077349f3bb728041975fecba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:52.564943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc63726077349f3bb728041975fecba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:52.642470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc63726077349f3bb728041975fecba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:52.643207 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc63726077349f3bb728041975fecba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:52.656979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4d89d7b6-de24-41ec-956e-8f5200a0c162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc63726077349f3bb728041975fecba'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:52.663769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1300/2589] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:08:52 2022] DELETE /identity/v3/users/4bc63726077349f3bb728041975fecba => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:53.387714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:53.400329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd525ea-9c93-4058-b98c-7f64381572cb service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:53.412063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:53.471697 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:53.472344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:53.472622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:53.474893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] PATH_INFO: `/v3/projects/faa6d8e0b3c64536b3c93d0925de562b` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:53.474893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa6d8e0b3c64536b3c93d0925de562b)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:53.477093 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:53.596618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa6d8e0b3c64536b3c93d0925de562b', 'request_id': 'req-39d140ba-de2d-4c16-a6ab-da89d7193aa7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:53.602278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa6d8e0b3c64536b3c93d0925de562b', 'request_id': 'req-39d140ba-de2d-4c16-a6ab-da89d7193aa7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:53.709055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa6d8e0b3c64536b3c93d0925de562b', 'request_id': 'req-39d140ba-de2d-4c16-a6ab-da89d7193aa7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:53.721852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] The token cache is being invalidate because project faa6d8e0b3c64536b3c93d0925de562b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:08:53.722377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:53.723068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-39d140ba-de2d-4c16-a6ab-da89d7193aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:08:53.724563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1290/2590] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:08:53 2022] DELETE /identity/v3/projects/faa6d8e0b3c64536b3c93d0925de562b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:08:53.729789 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:53.730269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:53.730352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:53.872387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:53.873791 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:53.878261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:53.946265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1301/2591] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:53.953878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:53.954167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:53.954703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:53.975859 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:53.977342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:53.986344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1291/2592] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:08:53.991319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.001472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f87c8-e097-4a05-81d9-b8257a42f5ea None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.006083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.007894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.008352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.008623 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.012958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:08:54.012958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.012958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.024487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1302/2593] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:08:54.028942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.039151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395eca-a261-46db-84b9-2f3ea707891e None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.044096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.044705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.044986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.045256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.045899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.047893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.221268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1292/2594] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:08:54 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:08:54.222320 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.232814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c1b87-a3b3-4fbe-919d-e84e40cec36b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.300177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.300904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.301186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.301453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.302145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.305392 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.391519 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1303/2595] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:08:54 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:08:54.395449 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.408581 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9aaae-586d-4421-b97a-f42df3e3261c admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.415871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.416489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.416975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.417255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.417904 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.419775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.433393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1293/2596] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:54.437554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.448964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07989b-92ce-4f48-b81a-eba53eccd8d1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.458172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.458853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.459187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.459508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.460453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.462066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f72b5-0947-425f-95cb-4a782242fa23 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.477482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1304/2597] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:08:54.482180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.494118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b23e-b385-4d0a-9c71-ba144a14e7e4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.498938 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.499676 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.500049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.500388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] PATH_INFO: `/v3/projects/f4bdb1f8bb1d44469c93bd454d9d2897/users/8181a309e17b44e28df51db202225427/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.526365 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bdb1f8bb1d44469c93bd454d9d2897, user_id=8181a309e17b44e28df51db202225427, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.530623 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.631778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1294/2598] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:08:54 2022] PUT /identity/v3/projects/f4bdb1f8bb1d44469c93bd454d9d2897/users/8181a309e17b44e28df51db202225427/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:08:54.637018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.637417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.638038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.657885 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:08:54.659147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:54.732503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1305/2599] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:08:54.740008 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:54.741867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:54.791858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:54.807184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc3cc4-c0ef-4602-bd41-b8fc82d69a17 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:54.811256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:54.811857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:54.812132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:54.812399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:54.821651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:54.823502 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:54.834021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1295/2600] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:57.120180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:57.121866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:57.137813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd535f0a-0c2f-4fc9-8596-b8ba9d29576f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:57.148165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:57.148165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:57.148165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:57.148165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:57.148567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:57.156397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:57.157875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370c6e3-ad6f-406f-b14d-bc5c1f6f9214 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:57.167534 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1306/2601] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:08:58.063506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:08:58.066349 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:58.169259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd7c-91c2-4aa8-898a-791d1eed7812 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:08:58.174656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:08:58.175313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:08:58.178362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:08:58.178650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:08:58.181945 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:08:58.199596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:08:58.202551 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:08:58.228059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1296/2602] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:08:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:00.644635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375d74-d658-4851-bcba-f10191678534 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:00.645196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375d74-d658-4851-bcba-f10191678534 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:00.645196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375d74-d658-4851-bcba-f10191678534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:00.653961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:00.678718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c6375d74-d658-4851-bcba-f10191678534 None None] MFA Rules not processed for user `8181a309e17b44e28df51db202225427`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:09:00.679973 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c6375d74-d658-4851-bcba-f10191678534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:00.754126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1307/2603] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:09:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:09:00.771222 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:00.773236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:00.856005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873deb4c-d6fd-4ff9-b065-9ea7e1349921 service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:00.862374 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:00.863042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:00.863327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:00.863601 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:00.875305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:00.878343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cdb85-a108-4414-920d-b88bbd42ef5b service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:00.889668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1297/2604] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:01.983826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375d74-d658-4851-bcba-f10191678534 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:02.001960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375d74-d658-4851-bcba-f10191678534 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:02.006328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:02.007146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:02.007545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:02.008037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:02.020700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:02.046219 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:02.048039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:02.060827 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1308/2605] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:03.739606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:03.741111 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:03.741544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:03.778936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] MFA Rules not processed for user `8181a309e17b44e28df51db202225427`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:09:03.780188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:03.788604 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1298/2606] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:09:09.395015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:09.397249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:09.414765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a808f-b194-441b-bb44-1fa8e9b9ebde service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:09.421138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:09.421746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:09.422025 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:09.422298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:09.424085 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:09.437318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:09.438605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:09.449907 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1309/2607] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:12.953057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:12.963700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1af78-6c4a-4d0a-a34c-46a51624313b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:12.967255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:12.967852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:12.968130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:12.968399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:12.970145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:13.016711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=100 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:13.033993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:13.035448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:13.046043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1299/2608] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:19.445321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=43 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:23.053190 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=8 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:53.451852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:53.462293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086131-2a54-4ef2-a738-28d8860137da service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:53.465882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:53.466467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:53.466776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:53.467053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:53.468777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:53.480480 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:53.481893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:53.491407 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1310/2609] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:57.198155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:57.199606 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:57.214399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605011-4016-4416-ba08-7fbd40ea75e3 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:57.219473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:57.220068 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:57.220345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:57.220628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:57.222262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:57.234524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:57.236131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:57.246577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1300/2610] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:09:57.340704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:57.340704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:57.353138 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c9a1e-6e4f-41fc-ad0f-39824b804b13 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:57.357794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:57.358412 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:57.358690 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:57.359017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] PATH_INFO: `/v3/users/0fc9a7bfd2dc48a6ab96957b23b45eeb` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:57.360136 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc9a7bfd2dc48a6ab96957b23b45eeb)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:57.362033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:57.568699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc9a7bfd2dc48a6ab96957b23b45eeb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:57.575547 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc9a7bfd2dc48a6ab96957b23b45eeb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:57.673424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc9a7bfd2dc48a6ab96957b23b45eeb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:57.674051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc9a7bfd2dc48a6ab96957b23b45eeb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:57.687626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-90a98d68-6605-4230-912c-35d079a43957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc9a7bfd2dc48a6ab96957b23b45eeb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:57.694891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1311/2611] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:09:57 2022] DELETE /identity/v3/users/0fc9a7bfd2dc48a6ab96957b23b45eeb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:09:57.938259 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:57.950654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be31beb-f9fa-46f8-857d-353da1903dba service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.013812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.014437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.014721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.015016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] PATH_INFO: `/v3/projects/bb9a70459fef46a9bedfec1b038027a3` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.016132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9a70459fef46a9bedfec1b038027a3)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.018013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.176626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9a70459fef46a9bedfec1b038027a3', 'request_id': 'req-93287632-9d70-49ef-8292-95fa4e810c6d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:58.182870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9a70459fef46a9bedfec1b038027a3', 'request_id': 'req-93287632-9d70-49ef-8292-95fa4e810c6d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:58.295819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9a70459fef46a9bedfec1b038027a3', 'request_id': 'req-93287632-9d70-49ef-8292-95fa4e810c6d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:58.308123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] The token cache is being invalidate because project bb9a70459fef46a9bedfec1b038027a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:09:58.308408 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:58.309029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-93287632-9d70-49ef-8292-95fa4e810c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:09:58.310496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1301/2612] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:09:57 2022] DELETE /identity/v3/projects/bb9a70459fef46a9bedfec1b038027a3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:09:58.315415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.315701 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.316050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.336589 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:09:58.337722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:58.397476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1312/2613] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:09:58.405304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.405587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.405862 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.426060 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:09:58.428504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:58.436396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1302/2614] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:09:58.440744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.451160 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab6eeb-4313-47b0-9e10-bf5ec93b46f6 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.456205 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.456790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.457068 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.457335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.457979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:09:58.458516 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.460993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.473439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1313/2615] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:09:58.478578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.488715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128c7ba-c36d-454d-b225-e39992b75c15 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.494163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.494781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.495236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.495673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.496306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.498280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.607701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1303/2616] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:09:58.612727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.623671 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66da36-399d-4bde-8c2d-638ca984ed84 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.668079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:58.682201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.683145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.683417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.683510 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.684261 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.686196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.829149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1314/2617] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:09:58 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:09:58.832724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.845009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4c6c9-cff9-48c6-b939-8b82bcbec7b7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.851590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.852207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.852486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.852753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.853587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.855230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.871238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1304/2618] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:09:58.872399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.883059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774cce1-b4d6-46a0-8b72-63e6f6e9ff2c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.889726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.889726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.889726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.889726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.890139 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.891199 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff56ed-47db-4ebb-9849-6d2ad241280e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:58.902476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1315/2619] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:09:58.906432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:58.917594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb66a-45a2-4860-8f49-71b949e58bbc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:58.922172 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:58.922848 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:58.923133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:58.923400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] PATH_INFO: `/v3/projects/749f3606a4f44eae88b5c1c41ae44b5a/users/aeb38b7f410c4e0e8413c4ceb10f5e20/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:58.938967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749f3606a4f44eae88b5c1c41ae44b5a, user_id=aeb38b7f410c4e0e8413c4ceb10f5e20, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:58.941609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:59.033191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1305/2620] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:09:58 2022] PUT /identity/v3/projects/749f3606a4f44eae88b5c1c41ae44b5a/users/aeb38b7f410c4e0e8413c4ceb10f5e20/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:09:59.045054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:59.045336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:59.045606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:59.073179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] MFA Rules not processed for user `aeb38b7f410c4e0e8413c4ceb10f5e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:09:59.074369 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:59.144166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1316/2621] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:09:59.162214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:09:59.164392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:09:59.179391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:59.237191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427dae-f1e1-45d4-b188-d16ac73ee630 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:09:59.242826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:09:59.243423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:09:59.243700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:09:59.243968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:09:59.252275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:09:59.253912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cd815-34f4-4561-a9ca-56338c5d71c4 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:09:59.263876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1306/2622] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:05.460465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:05.518148 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3d6b7-501e-4752-9dfa-5f963b23d670 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:05.523367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:05.523975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:05.524248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:05.524512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] PATH_INFO: `/v3/users/aeb38b7f410c4e0e8413c4ceb10f5e20` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:05.525601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb38b7f410c4e0e8413c4ceb10f5e20)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:05.527515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:05.724846 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb38b7f410c4e0e8413c4ceb10f5e20'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:05.732446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb38b7f410c4e0e8413c4ceb10f5e20'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:05.734352 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:05.810503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb38b7f410c4e0e8413c4ceb10f5e20'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:05.811314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb38b7f410c4e0e8413c4ceb10f5e20'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:05.826075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb38b7f410c4e0e8413c4ceb10f5e20'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:05.832437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1317/2623] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:10:05 2022] DELETE /identity/v3/users/aeb38b7f410c4e0e8413c4ceb10f5e20 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:05.837965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:05.838484 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:05.838685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:05.861501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:05.862753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:05.972430 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1307/2624] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:05.983904 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:05.986960 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:06.067879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ccb4-8875-4ec6-84d9-22fbab7d0ffc admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:06.071770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:06.072367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:06.072660 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:06.074176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:06.088162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:06.089629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182d010-3f79-4132-98bf-fac9f92aa503 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:06.100421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1318/2625] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:06.584216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:06.586057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:06.599180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d60f-76dc-45e0-800a-80d7ce7f59ab None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:06.604512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:06.605161 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:06.605441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:06.605716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] PATH_INFO: `/v3/projects/749f3606a4f44eae88b5c1c41ae44b5a` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:06.606988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=749f3606a4f44eae88b5c1c41ae44b5a)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:06.609027 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:06.731179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749f3606a4f44eae88b5c1c41ae44b5a', 'request_id': 'req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:06.737007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749f3606a4f44eae88b5c1c41ae44b5a', 'request_id': 'req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:06.850901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749f3606a4f44eae88b5c1c41ae44b5a', 'request_id': 'req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:06.862323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] The token cache is being invalidate because project 749f3606a4f44eae88b5c1c41ae44b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:10:06.862608 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:06.863290 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e0c9b0f6-05d5-431f-ba4d-e77302d6e21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:06.865332 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1308/2626] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:10:06 2022] DELETE /identity/v3/projects/749f3606a4f44eae88b5c1c41ae44b5a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:06.870446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:06.875686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:06.875686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:06.891443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:06.892665 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:06.951901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1319/2627] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:06.960002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:06.960289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:06.960562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:06.980654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:06.981854 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:06.990426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1309/2628] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:06.994604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.004336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf3877-3402-4ace-9392-79d1066c21bb None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.008912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.009499 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.009772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.010039 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.010678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:10:07.011006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.012588 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.024141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1320/2629] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:10:07.028334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.038440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9534e-d743-4511-83c0-8c7c9d2c5667 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.043786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.044617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.044722 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.044895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.045528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.047470 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.063344 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:07.200619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1310/2630] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:10:07 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:10:07.204687 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.215911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dafcc-ae6b-4bd0-9d26-2e00e268dae8 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.272177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.272775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.273048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.273317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.274327 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.275902 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.285796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:07.370855 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1321/2631] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:10:07 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:10:07.372186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.383019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda960b6-f1ba-4c17-b61a-b10c745ddc1e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.387659 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.388199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.388474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.388737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.389410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.391023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.401362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1311/2632] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:07.405413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.415951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf675103-cd40-4eb8-8516-5420be90e90c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.420643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.421237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.421518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.421792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.422430 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.424073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570349-7fc3-4e56-a370-25b4d7b40629 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.434496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1322/2633] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:07.438611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.448636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3563b-7032-430f-bf89-f8fbb28fdee4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.453280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.453919 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.454196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.454462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] PATH_INFO: `/v3/projects/b64ac7cbd2cb40159f18e48daf4e6fd5/users/9019e0627a1d4becb91948faa74888a2/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.470649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64ac7cbd2cb40159f18e48daf4e6fd5, user_id=9019e0627a1d4becb91948faa74888a2, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.473285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.590845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1312/2634] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:10:07 2022] PUT /identity/v3/projects/b64ac7cbd2cb40159f18e48daf4e6fd5/users/9019e0627a1d4becb91948faa74888a2/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:07.602814 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87bf0-76d7-4710-9272-2a3101833f4b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.603096 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87bf0-76d7-4710-9272-2a3101833f4b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.603378 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87bf0-76d7-4710-9272-2a3101833f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.632452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-dcd87bf0-76d7-4710-9272-2a3101833f4b None None] MFA Rules not processed for user `9019e0627a1d4becb91948faa74888a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:07.636089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dcd87bf0-76d7-4710-9272-2a3101833f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:07.696613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1323/2635] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:07.707718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:07.710312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:07.767763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b9a04-608b-440a-8c9a-d065a514cf11 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:07.772373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:07.772978 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:07.773278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:07.773530 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:07.782081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:07.783534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:07.793698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1313/2636] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:16.850808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:16.851367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:16.851367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:16.871129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:16.873824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:16.927552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1324/2637] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:10:17.126054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:17.127740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:17.199405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109596-b38b-42a2-bfe5-5717f8cd6c1d service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:17.204657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:17.205273 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:17.205533 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:17.205808 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:17.214915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:17.216540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae13b7-83d5-4bf9-81fa-e246e3e5dc43 service swift] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:17.225168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1314/2638] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:10:17.661686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:17.744459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9900a7-dfcc-4101-87dd-e290145edafb None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:17.749783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:17.750500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:17.750850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:17.751178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] PATH_INFO: `/v3/users/9019e0627a1d4becb91948faa74888a2` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:17.752319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9019e0627a1d4becb91948faa74888a2)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:17.754632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:17.788897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:17.994503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9019e0627a1d4becb91948faa74888a2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:18.002558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9019e0627a1d4becb91948faa74888a2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:18.072230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9019e0627a1d4becb91948faa74888a2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:18.072230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9019e0627a1d4becb91948faa74888a2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:18.086583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9019e0627a1d4becb91948faa74888a2'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:18.097490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1325/2639] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:10:17 2022] DELETE /identity/v3/users/9019e0627a1d4becb91948faa74888a2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:18.102086 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:18.102494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:18.102875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:18.132002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:18.133372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:18.203156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:18.228763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1315/2640] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:10:18.238182 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:18.240567 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:18.311832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edc7ae-e50a-430d-9874-1b07e1d7bed4 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:18.317867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:18.318705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:18.319073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:18.319409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:18.330230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:18.332260 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:18.346197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1326/2641] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:18.452692 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:18.454837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:18.565570 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb3bcc-9a1c-4e1c-9af3-1dac347b6eae None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:18.576284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:18.577211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:18.577567 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:18.577901 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:18.579847 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:18.602307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:18.604321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdcd53-56ab-47b5-bdc1-7e2d4b213b85 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:18.622231 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1316/2642] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:18.971803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:18.973237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:18.997383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333c0d-face-4bd2-bf7f-8d0f3b3cbefd service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:19.002470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:19.008615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.008615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.008615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] PATH_INFO: `/v3/projects/b64ac7cbd2cb40159f18e48daf4e6fd5` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.008615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64ac7cbd2cb40159f18e48daf4e6fd5)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:19.010952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:19.190265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64ac7cbd2cb40159f18e48daf4e6fd5', 'request_id': 'req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:19.197269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64ac7cbd2cb40159f18e48daf4e6fd5', 'request_id': 'req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:19.203220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64ac7cbd2cb40159f18e48daf4e6fd5', 'request_id': 'req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:19.305627 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] The token cache is being invalidate because project b64ac7cbd2cb40159f18e48daf4e6fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:10:19.305950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:19.306711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ff29ea40-7bf7-4d48-b62f-7ce4b459f14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:10:19.311769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1327/2643] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:10:18 2022] DELETE /identity/v3/projects/b64ac7cbd2cb40159f18e48daf4e6fd5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:19.313586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.314121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.314395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.347206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:19.348734 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:19.424948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1317/2644] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:19.434312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.434705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.435073 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.457087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:19.458592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:19.467518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1328/2645] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:19.471816 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:19.483334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b26ad-c325-4119-932f-d9b77a651485 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:19.488262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:19.488888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.489821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.490276 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.491035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:10:19.491636 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:19.493340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:19.508433 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1318/2646] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:10:19.512723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:19.524536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e68e5-a9e7-440f-8ea0-9ca4376178be None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:19.529849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:19.530460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.530762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.531097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.531740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:19.533648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:19.552373 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:19.698409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1329/2647] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:10:19 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:10:19.703070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:19.714494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673c741-b79d-4dcb-a9ba-4c90464a0991 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:19.780526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:19.781169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.781448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.781715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.782350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:19.784537 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:19.795822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:19.961381 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1319/2648] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:10:19 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:10:19.965756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:19.977945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c089f3-8a31-43bf-b343-8ab051b7db96 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:19.982956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:19.983616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:19.983890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:19.984159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:19.984822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:19.986496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:19.998097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1330/2649] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:20.002253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:20.012593 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74526-bb7b-4ede-9348-c13de51279ef admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:20.017148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:20.017737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:20.018018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:20.018285 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:20.018950 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:20.021023 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405e5f-093e-4788-a0fd-614224acf8e9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:20.032277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1320/2650] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:20.037212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:20.049048 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf57147-1cb5-4f2c-a29f-eafc159abea7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:20.054456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:20.055233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:20.055546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:20.055821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] PATH_INFO: `/v3/projects/cccd696b434b48b9bea451e2cd32b6f8/users/700d13a003e84ba3a3f60185b72487c4/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:20.074971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccd696b434b48b9bea451e2cd32b6f8, user_id=700d13a003e84ba3a3f60185b72487c4, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:20.079147 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:20.602123 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1331/2651] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:10:20 2022] PUT /identity/v3/projects/cccd696b434b48b9bea451e2cd32b6f8/users/700d13a003e84ba3a3f60185b72487c4/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:10:20.612663 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:20.613156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:20.613251 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:20.643272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] MFA Rules not processed for user `700d13a003e84ba3a3f60185b72487c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:20.644488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:20.720647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1321/2652] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:20.725164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:20.798685 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956eaf1-2c5e-4823-9bf3-faab10996b17 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:20.804332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:20.804956 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:20.805780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:20.806403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:20.807597 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:20.809574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:20.905183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1332/2653] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:10:20 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:10:20.908893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:20.924106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dcea7-5087-42e1-91cc-c8ca9d4a2153 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.012254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.012869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.013144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.013413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.014052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.016009 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.143668 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1322/2654] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:10:20 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:10:21.147703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:21.161280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff6745-914e-4310-963e-b91305cf8f48 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.166989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.167686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.170217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.170217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.170217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.170777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.184097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1333/2655] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:21.188476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:21.200830 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9567ef-1cb2-4f1b-983e-1693263faa4e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.205558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.206475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.206775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.207052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] PATH_INFO: `/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414/users/afa6a5bfdef44fd6bf6517f75bf24068/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.226696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8d2fd61f44b948ff9544aaa2ce414, user_id=afa6a5bfdef44fd6bf6517f75bf24068, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.229550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.312540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1323/2656] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:10:21 2022] PUT /identity/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414/users/afa6a5bfdef44fd6bf6517f75bf24068/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:21.316782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:21.345015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce10f87-536f-41f6-8c1f-d8b2b03ec19b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.453256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.453983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.454359 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.454765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.455513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.457481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e71ad-a47f-4c25-9ace-e488ea7a69e6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.477176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1334/2657] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:10:21.478893 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:21.493083 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ba98-bf69-47f7-9dd0-f72ce6408347 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.500123 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.500798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.501077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.501480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] PATH_INFO: `/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414/users/afa6a5bfdef44fd6bf6517f75bf24068/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.503742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8d2fd61f44b948ff9544aaa2ce414, user_id=afa6a5bfdef44fd6bf6517f75bf24068, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.507463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.530947 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1324/2658] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:10:21 2022] PUT /identity/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414/users/afa6a5bfdef44fd6bf6517f75bf24068/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:10:21.534584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.535600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.535600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.573402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] MFA Rules not processed for user `afa6a5bfdef44fd6bf6517f75bf24068`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:21.574673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:21.602029 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:21.665397 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1335/2659] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:21.677829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:21.679696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:21.712146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:21.748357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c015bc-206f-4330-84f0-57d5afaa9358 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:21.755037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:21.755704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:21.756071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:21.756340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:21.769943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:21.771452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:21.783291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1325/2660] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:21.997183 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:22.008040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2ded7-e2f4-45d8-ae51-504875165af1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:22.017099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:22.017719 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:22.017999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:22.018270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:22.097224 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:22.099631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a901-f3cb-4273-b4db-e2d8ef9a5b56 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:22.109912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1336/2661] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:31.787932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=15 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:32.105692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=49 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:33.444584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:33.446000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:33.504483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd62c-8d8d-4d77-8439-d2d12fe8fdd8 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:33.508367 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:33.508969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:33.509243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:33.509509 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:33.511260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:33.522175 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:33.523441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490ff7-38e6-4941-b29c-eebc93f8f7c5 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:33.531442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1326/2662] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:33.890544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:33.891161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:33.891287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:33.892553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1337/2663] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:10:33.899334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85293a-b5fd-4246-8a12-0d721a3d40c0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:33.899620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85293a-b5fd-4246-8a12-0d721a3d40c0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:33.899895 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85293a-b5fd-4246-8a12-0d721a3d40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:33.919856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-fd85293a-b5fd-4246-8a12-0d721a3d40c0 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:33.921075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-fd85293a-b5fd-4246-8a12-0d721a3d40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:33.990632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1327/2664] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:10:34.001815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:34.003528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:34.062819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a45222-733d-4a2d-81c7-90f503e553c5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:34.066267 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:34.066897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.067178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.067449 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.079083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:34.080575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7968-af06-4414-a388-d710cf023e2c service glance] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:34.093097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1338/2665] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:34.301147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247ee5-5b5e-4e63-9f6e-4a1902a34ebd None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.301521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247ee5-5b5e-4e63-9f6e-4a1902a34ebd None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.301864 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247ee5-5b5e-4e63-9f6e-4a1902a34ebd None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.304100 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1328/2666] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:10:34.309001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0fed9-2f73-4798-bce3-97853a3494f4 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.309282 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0fed9-2f73-4798-bce3-97853a3494f4 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.309552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0fed9-2f73-4798-bce3-97853a3494f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.329648 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-27d0fed9-2f73-4798-bce3-97853a3494f4 None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:34.330894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-27d0fed9-2f73-4798-bce3-97853a3494f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:34.337724 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1339/2667] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:10:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:34.349786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247ee5-5b5e-4e63-9f6e-4a1902a34ebd None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:34.360801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247ee5-5b5e-4e63-9f6e-4a1902a34ebd None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:34.364351 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:34.365505 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.365781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.366053 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.373113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:34.374529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefc6d4-227a-4662-8c28-7ef3bab34eb6 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:34.382908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1329/2668] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:34.468985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decf8a-6a37-4a41-92a1-cdddc9f309ce None None] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.469469 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decf8a-6a37-4a41-92a1-cdddc9f309ce None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.469747 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decf8a-6a37-4a41-92a1-cdddc9f309ce None None] PATH_INFO: `/` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.471165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1340/2669] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 18:10:34.479092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abfce-6d18-4f75-9955-ece7f30adbc5 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.479614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abfce-6d18-4f75-9955-ece7f30adbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.479614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abfce-6d18-4f75-9955-ece7f30adbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.500990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8c8abfce-6d18-4f75-9955-ece7f30adbc5 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:34.502310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8c8abfce-6d18-4f75-9955-ece7f30adbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:34.512301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1330/2670] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:10:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:34.523070 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8decf8a-6a37-4a41-92a1-cdddc9f309ce None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:34.534417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8decf8a-6a37-4a41-92a1-cdddc9f309ce None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:34.538751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:34.539351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:34.539629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:34.539899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:34.550099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:34.551549 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:34.562632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1341/2671] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:10:37.881277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0d0-56c7-4816-9e81-f87685764cf8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:37.881860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0d0-56c7-4816-9e81-f87685764cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:37.881860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a0d0-56c7-4816-9e81-f87685764cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:37.900907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9830a0d0-56c7-4816-9e81-f87685764cf8 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:37.902130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9830a0d0-56c7-4816-9e81-f87685764cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:37.958673 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1331/2672] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:10:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:37.970872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:37.972328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:38.041227 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb195c7f-d628-4e59-8b46-d9006d7b7f8c service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:38.046250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:38.046879 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:38.050631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:38.050631 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:38.056054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:38.057707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:38.065709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1342/2673] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:10:47.951482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:48.062453 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=67 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:54.801804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:54.802308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:54.802405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:54.823155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:10:54.824382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:10:54.831538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1332/2674] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:10:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:10:54.844348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:10:54.855823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2bc84-a355-4380-8700-f428c0ee0ed0 service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:10:54.861082 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:10:54.861695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:10:54.861969 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:10:54.862237 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:10:54.870301 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:10:54.871891 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbeda-d294-4536-a611-c58c6462a1d3 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:10:54.879696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1343/2675] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:10:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:11:01.132874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:01.197725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057dce-50fc-4c75-b16a-29ec307b12aa None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:01.202234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:01.202894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:01.203168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:01.203432 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] PATH_INFO: `/v3/users/700d13a003e84ba3a3f60185b72487c4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:01.204546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=700d13a003e84ba3a3f60185b72487c4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:01.206443 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:01.400324 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700d13a003e84ba3a3f60185b72487c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:01.407504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700d13a003e84ba3a3f60185b72487c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:01.470833 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700d13a003e84ba3a3f60185b72487c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:01.484277 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700d13a003e84ba3a3f60185b72487c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:01.487630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700d13a003e84ba3a3f60185b72487c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:01.490672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1333/2676] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:01 2022] DELETE /identity/v3/users/700d13a003e84ba3a3f60185b72487c4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:01.495822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:01.496289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:01.496399 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:01.515722 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:01.516937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:01.584075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1344/2677] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:01.593777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:01.595239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:01.652690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea33df-6afb-4eda-8112-c89d6c4c9b6d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:01.656260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:01.656850 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:01.657122 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:01.657385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:01.666561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:01.667993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:01.677153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1334/2678] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:02.066128 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:02.067472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:02.079772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba03ba-15e8-4dea-833b-041c90832ca1 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:02.084914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:02.089853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:02.089853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:02.089853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] PATH_INFO: `/v3/projects/cccd696b434b48b9bea451e2cd32b6f8` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:02.089853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccd696b434b48b9bea451e2cd32b6f8)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:02.089853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:02.204289 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccd696b434b48b9bea451e2cd32b6f8', 'request_id': 'req-b6a10abb-faff-4732-9949-5ff7d152775a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.210612 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccd696b434b48b9bea451e2cd32b6f8', 'request_id': 'req-b6a10abb-faff-4732-9949-5ff7d152775a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.216625 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccd696b434b48b9bea451e2cd32b6f8', 'request_id': 'req-b6a10abb-faff-4732-9949-5ff7d152775a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.288729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] The token cache is being invalidate because project cccd696b434b48b9bea451e2cd32b6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:02.289108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.289889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.291562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1345/2679] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:02 2022] DELETE /identity/v3/projects/cccd696b434b48b9bea451e2cd32b6f8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:02.295703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:02.305441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a2a9-c967-4b97-9fa6-45ae3b574808 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:02.318156 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:02.364188 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:02.364943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:02.365216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:02.365480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] PATH_INFO: `/v3/users/afa6a5bfdef44fd6bf6517f75bf24068` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:02.366615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa6a5bfdef44fd6bf6517f75bf24068)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:02.368574 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:02.577447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa6a5bfdef44fd6bf6517f75bf24068'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.584452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa6a5bfdef44fd6bf6517f75bf24068'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.664096 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa6a5bfdef44fd6bf6517f75bf24068'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.676923 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa6a5bfdef44fd6bf6517f75bf24068'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.677561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d9d2615c-0019-4fc7-93c6-47d0a1734db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa6a5bfdef44fd6bf6517f75bf24068'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:02.683980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1335/2680] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:02 2022] DELETE /identity/v3/users/afa6a5bfdef44fd6bf6517f75bf24068 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:03.081078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.083788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:03.100230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10abb-faff-4732-9949-5ff7d152775a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.165647 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.166718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.166718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.167509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] PATH_INFO: `/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.168356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d8d2fd61f44b948ff9544aaa2ce414)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.170826 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.185717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:03.295785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d8d2fd61f44b948ff9544aaa2ce414', 'request_id': 'req-582170a4-4af1-4d76-80ca-3f5a400e25aa'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:03.302015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d8d2fd61f44b948ff9544aaa2ce414', 'request_id': 'req-582170a4-4af1-4d76-80ca-3f5a400e25aa'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:03.309008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d8d2fd61f44b948ff9544aaa2ce414', 'request_id': 'req-582170a4-4af1-4d76-80ca-3f5a400e25aa'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:03.420726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] The token cache is being invalidate because project c6d8d2fd61f44b948ff9544aaa2ce414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:03.420942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:03.421540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-582170a4-4af1-4d76-80ca-3f5a400e25aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:03.423264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1346/2681] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:03 2022] DELETE /identity/v3/projects/c6d8d2fd61f44b948ff9544aaa2ce414 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:03.428211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.428684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.428801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.448983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:03.450171 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:03.511924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1336/2682] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:03.520887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.521195 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.521465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.541152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:03.542356 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:03.550110 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1347/2683] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:03.554275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.565022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b03fb-5b41-4847-89ce-3c2d20e08390 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.569655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.570979 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.571263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.571534 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.572187 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:11:03.572492 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.574163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.586095 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1337/2684] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:11:03.590506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.599688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aabaf6-fc80-4041-8d3a-96a1cfc690d0 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.604380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.604972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.605249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.605523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.606154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.608075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.724444 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1348/2685] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:03 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:11:03.729295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.739517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be18c-4344-4335-946b-24a64c93ea5e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.758871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:03.795555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.796141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.796419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.796684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.797304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.799227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.911975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1338/2686] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:03 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:03.916540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.926954 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154eb7e-a4ca-4fa8-9a6e-a0fbd7701e86 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.932235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.932822 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.933101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.933370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.934005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.935644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.945705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1349/2687] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:03.949792 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.960002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aa95f-9715-43d5-a237-f1ea7db977b9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.965236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:03.965829 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:03.966103 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:03.966368 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:03.967042 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:03.968622 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8ca2-1495-4926-96f4-ecda4837b85a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:03.980837 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1339/2688] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:03.984360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:03.994991 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7deb-95d3-41e8-96b8-f450e46defed admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:03.999556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.000192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.000472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.000748 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] PATH_INFO: `/v3/projects/a22bb90becac4479a0ff49f7435f5d81/users/d78b4f78f41f4fa9919dc366c88a71d7/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.015272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22bb90becac4479a0ff49f7435f5d81, user_id=d78b4f78f41f4fa9919dc366c88a71d7, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.017915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.112193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1350/2689] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:03 2022] PUT /identity/v3/projects/a22bb90becac4479a0ff49f7435f5d81/users/d78b4f78f41f4fa9919dc366c88a71d7/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:11:04.123373 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.123655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.123922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.153305 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] MFA Rules not processed for user `d78b4f78f41f4fa9919dc366c88a71d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:04.154540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:04.219617 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1340/2690] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:04.224231 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.285829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94469-3193-4e0d-a05d-2490e70b9e97 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.291432 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.292005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.292285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.292550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.293179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.295109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.393299 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1351/2691] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:04 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:04.397559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.409031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93117-a29d-4f9d-9ec4-e9dc0fec2406 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.464823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.465442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.465684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.465959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.466585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.468527 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.550047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1341/2692] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:04 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:11:04.554158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.564955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3f9b0-d268-459f-aa6e-5e86ae3728ea admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.569666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.570989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.571470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.571753 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.572393 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.574031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.584779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1352/2693] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:04.589640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.599558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f072b-7cc9-408e-9a0f-7cb513491fa9 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.604242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.604879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.605154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.605424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] PATH_INFO: `/v3/projects/9ae2275338b44551941f37c2c4f50779/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.619700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae2275338b44551941f37c2c4f50779, user_id=e08bc519cf7a4fdaa1d176cfbcb5b1ff, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.622314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.625393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:04.706110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1342/2694] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:04 2022] PUT /identity/v3/projects/9ae2275338b44551941f37c2c4f50779/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:04.710353 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.721185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb7f2-a02c-4fd0-9cb8-607d1f39000e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.729387 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:04.777839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.778473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.778778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.779054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.779704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.781331 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a914f96-9b59-4fee-955d-3bdf4d1ce9db admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.792445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1353/2695] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:11:04.796072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.810196 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c45d-eef6-4aef-814a-8bc0116aa929 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:04.815160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:04.815823 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.816106 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.816399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] PATH_INFO: `/v3/projects/9ae2275338b44551941f37c2c4f50779/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.818491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae2275338b44551941f37c2c4f50779, user_id=e08bc519cf7a4fdaa1d176cfbcb5b1ff, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:04.822262 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:04.833197 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1343/2696] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:04 2022] PUT /identity/v3/projects/9ae2275338b44551941f37c2c4f50779/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:04.844346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:04.844630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:04.844900 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:04.872958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] MFA Rules not processed for user `e08bc519cf7a4fdaa1d176cfbcb5b1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:04.874159 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:04.943476 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1354/2697] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:04.954497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:04.956573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:05.014839 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab55a7-6ce9-4542-a4ad-b468ec8e47f3 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:05.018422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:05.019043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:05.019314 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:05.019577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:05.075377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:05.076798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:05.086391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1344/2698] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:06.851032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:06.852575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:06.865427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbd29f-4803-42ee-9b21-037563812aad None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:06.869649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:06.870247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:06.870526 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:06.870832 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:06.879913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:06.881344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cce9c-b31f-4f11-ba31-8f2a72405d0e service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:06.891119 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1355/2699] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:11.290129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:11.357014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e35f7-ed59-43e5-8388-1f9ef6edfc2a service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:11.361552 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:11.362151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:11.362423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:11.362688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] PATH_INFO: `/v3/users/d78b4f78f41f4fa9919dc366c88a71d7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:11.363828 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78b4f78f41f4fa9919dc366c88a71d7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:11.365713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:11.558360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:11.564147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78b4f78f41f4fa9919dc366c88a71d7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:11.570983 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78b4f78f41f4fa9919dc366c88a71d7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:11.654990 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78b4f78f41f4fa9919dc366c88a71d7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:11.669360 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78b4f78f41f4fa9919dc366c88a71d7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:11.669992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78b4f78f41f4fa9919dc366c88a71d7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:11.675860 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1345/2700] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:11 2022] DELETE /identity/v3/users/d78b4f78f41f4fa9919dc366c88a71d7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:11.680365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:11.680865 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:11.680966 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:11.700284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:11.701490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:11.761241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1356/2701] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:11.771684 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:11.773097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:11.833000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765e865-323f-4951-b2dc-30e9109d4e6e admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:11.836629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:11.837226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:11.837500 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:11.837766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:11.847696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:11.855878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:11.858748 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1346/2702] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:12.313742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:12.315185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:12.333445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6b4cd-2d46-4293-a96c-f0ede3d6067b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:12.333445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:12.333949 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:12.334233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:12.334507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] PATH_INFO: `/v3/projects/a22bb90becac4479a0ff49f7435f5d81` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:12.335662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22bb90becac4479a0ff49f7435f5d81)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:12.337619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:12.357256 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:12.448706 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22bb90becac4479a0ff49f7435f5d81', 'request_id': 'req-01e4498a-a043-4298-bef5-3279fd680863'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.454783 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22bb90becac4479a0ff49f7435f5d81', 'request_id': 'req-01e4498a-a043-4298-bef5-3279fd680863'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.460417 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22bb90becac4479a0ff49f7435f5d81', 'request_id': 'req-01e4498a-a043-4298-bef5-3279fd680863'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.539712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] The token cache is being invalidate because project a22bb90becac4479a0ff49f7435f5d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:12.539999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.540614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.542078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1357/2703] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:12 2022] DELETE /identity/v3/projects/a22bb90becac4479a0ff49f7435f5d81 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:12.546021 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:12.555906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cead8-ccf0-4422-9ea5-b0aab99d2afa service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:12.613292 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:12.613927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:12.614209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:12.614481 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] PATH_INFO: `/v3/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:12.615762 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08bc519cf7a4fdaa1d176cfbcb5b1ff)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:12.617666 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:12.769511 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08bc519cf7a4fdaa1d176cfbcb5b1ff'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.776206 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08bc519cf7a4fdaa1d176cfbcb5b1ff'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.780544 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:12.866236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08bc519cf7a4fdaa1d176cfbcb5b1ff'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.878609 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08bc519cf7a4fdaa1d176cfbcb5b1ff'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.879304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-d4ab832e-ba30-4a96-8630-1e8d94cd8d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08bc519cf7a4fdaa1d176cfbcb5b1ff'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:12.885356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1347/2704] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:12 2022] DELETE /identity/v3/users/e08bc519cf7a4fdaa1d176cfbcb5b1ff => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:11:13.315164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:13.316707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:13.329946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4498a-a043-4298-bef5-3279fd680863 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:13.392792 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:13.393446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.393707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.393976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] PATH_INFO: `/v3/projects/9ae2275338b44551941f37c2c4f50779` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.400934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae2275338b44551941f37c2c4f50779)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:13.400934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:13.518203 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae2275338b44551941f37c2c4f50779', 'request_id': 'req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:13.524422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae2275338b44551941f37c2c4f50779', 'request_id': 'req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:13.529874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae2275338b44551941f37c2c4f50779', 'request_id': 'req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:13.626812 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] The token cache is being invalidate because project 9ae2275338b44551941f37c2c4f50779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:13.627031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:13.627697 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a95c984d-4f4f-4dc1-b1e8-df550c6c8763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:13.629201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1358/2705] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:13 2022] DELETE /identity/v3/projects/9ae2275338b44551941f37c2c4f50779 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:13.634195 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.634761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.634761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.656457 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:13.657685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:13.718563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1348/2706] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:13.727339 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.727618 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.727889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.747767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:13.748958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:13.756619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1359/2707] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:13.760649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:13.770988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be78776-4334-40d2-bfdc-144655a2805f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:13.775613 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:13.776204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.776482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.776834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.777478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:11:13.777788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:13.780522 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:13.792070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1349/2708] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:11:13.797246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:13.806425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df922f3-66e8-40b1-9904-c5fed1dce234 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:13.811154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:13.811742 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.812020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.812297 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.812919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:13.814841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:13.906513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1360/2709] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:13 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:13.910784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:13.921732 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfef68-5eee-494a-9754-58b62f5edae7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:13.977806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:13.978402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:13.978681 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:13.978976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:13.979611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:13.981510 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.082293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1350/2710] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:13 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:14.086532 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.094287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:14.098018 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6e70-a202-42d9-bcf8-b13d40c51b03 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.102868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.103459 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.103738 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.104008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.104802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.106351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.116613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1361/2711] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:14.120614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.130497 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410c292-2fdb-419f-8ddc-5002c619041a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.135409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.136012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.136293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.136563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.137234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.139575 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02970736-106d-4c66-adeb-65cd9f6838a6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.150415 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1351/2712] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:14.155336 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.165735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca9458-b5fc-4df2-83f0-5480626dad1b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.171116 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.171872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.172358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.172707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] PATH_INFO: `/v3/projects/78ce215faed34873a421024403cd84fd/users/0ea827ca20514746ac6a376418c995f9/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.188763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ce215faed34873a421024403cd84fd, user_id=0ea827ca20514746ac6a376418c995f9, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.191441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.259982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1362/2713] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:14 2022] PUT /identity/v3/projects/78ce215faed34873a421024403cd84fd/users/0ea827ca20514746ac6a376418c995f9/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:14.270977 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.271258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.271526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.300399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] MFA Rules not processed for user `0ea827ca20514746ac6a376418c995f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:14.301598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:14.333458 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:14.365462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1352/2714] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:14.370066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.433415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3bed-b21e-4069-a5dd-42ac2aac58d7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.438771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.439372 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.439653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.439924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.440544 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.442445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.549005 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1363/2715] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:14 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:14.550154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.561975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1926-a56e-4aaa-8917-bbf9145e8d6b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.619810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.620419 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.620698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.620969 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.621591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.624031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.705588 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1353/2716] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:14 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:14.709992 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.720570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffda-8d30-4a3f-9a6c-4ee8c17e13a7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.725158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.725740 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.726015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.726280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.726936 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.728524 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.739640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1364/2717] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:14.743625 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.754211 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e11d-dddf-4137-bd60-137972f67653 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.758773 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.759362 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.759639 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.759928 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.760560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.762164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37af611-8c0b-43c2-bee6-88f300fb51e4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.772306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1354/2718] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:11:14.776286 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:14.786146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebda414-8240-4ebf-a666-53eb2fbf226a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:14.790705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:14.791364 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.791640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.791912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] PATH_INFO: `/v3/projects/195ebf20f955447cbef67924f75d73a4/users/b225c519454e4597a0719acd7ca070fc/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.806836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195ebf20f955447cbef67924f75d73a4, user_id=b225c519454e4597a0719acd7ca070fc, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:14.809455 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:14.883214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1365/2719] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:14 2022] PUT /identity/v3/projects/195ebf20f955447cbef67924f75d73a4/users/b225c519454e4597a0719acd7ca070fc/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:14.894796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:14.895117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:14.895391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:14.923753 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] MFA Rules not processed for user `b225c519454e4597a0719acd7ca070fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:14.924963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:14.991894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1355/2720] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:14.996423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.056616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc874e-0040-417d-a590-c2c8492dfd51 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.061815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.062400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.065092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.065092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.065092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.065439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.161451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1366/2721] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:14 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:15.164084 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.175670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21274f92-2153-49fa-9604-dae16ef1a997 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.228410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:15.236826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.242414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.242414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.242414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.242414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.242414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.437657 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1356/2722] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:15 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:15.441678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.448570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:15.453492 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ecb62-c09d-4a15-a29a-6a0b33d1c8ea admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.456830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.457676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.457947 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.458214 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.458889 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.460512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.473355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1367/2723] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:15.477704 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.488913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739c06-8a22-43c1-a703-090267000dcc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.493462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.494107 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.494383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.494654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] PATH_INFO: `/v3/projects/b223f556650b40f8aba739bf7346c67c/users/72083a94fe55447588af33a970b70611/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.509620 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b223f556650b40f8aba739bf7346c67c, user_id=72083a94fe55447588af33a970b70611, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.513630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.624654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1357/2724] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:15 2022] PUT /identity/v3/projects/b223f556650b40f8aba739bf7346c67c/users/72083a94fe55447588af33a970b70611/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:15.628746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.639570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94acc94-548f-42b9-90af-c4fce0a37824 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.703242 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.703847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.704124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.704396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.705040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.706757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8aaa-0bd2-40ad-bea3-b7acc0be75ea admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.717579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1368/2725] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:15.721776 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.732800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6825d-7f67-4355-aa6e-ea53a7ce6643 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.737384 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.738037 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.738311 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.738577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] PATH_INFO: `/v3/projects/b223f556650b40f8aba739bf7346c67c/users/72083a94fe55447588af33a970b70611/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.740629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] RBAC: Authorizing `identity:create_grant(project_id=b223f556650b40f8aba739bf7346c67c, user_id=72083a94fe55447588af33a970b70611, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:15.743336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:15.754968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1358/2726] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:15 2022] PUT /identity/v3/projects/b223f556650b40f8aba739bf7346c67c/users/72083a94fe55447588af33a970b70611/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:15.820217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.820502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.820779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:15.849426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] MFA Rules not processed for user `72083a94fe55447588af33a970b70611`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:15.850630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:15.920450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1369/2727] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:15.931496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:15.933234 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:15.993785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ec7f9-2e9b-44ba-a6af-dab276a5aece admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:15.997856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:15.998483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:15.998788 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:15.999062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:16.055473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:16.056889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:16.065649 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1359/2728] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:18.078406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:18.079837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:18.093177 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc67c8-999e-4c95-b881-c40ff693286b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:18.096830 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:18.097531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:18.097810 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:18.098079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:18.160555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:18.161977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:18.171415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1370/2729] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:19.593995 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:19.602523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ba88-8497-4e68-b630-bcbea53c47ef service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:19.606114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:19.606699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:19.607003 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:19.607270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:19.615871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:19.617278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcad45-7474-4649-8c69-5426d6b54fd8 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:19.626987 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1360/2730] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:24.354696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:24.368663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:24.422481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c61f-7f41-454d-b579-2559e80ed50f service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:24.427862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:24.428513 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:24.428794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:24.429101 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] PATH_INFO: `/v3/users/0ea827ca20514746ac6a376418c995f9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:24.430232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea827ca20514746ac6a376418c995f9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:24.432188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:24.657626 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea827ca20514746ac6a376418c995f9'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:24.664250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea827ca20514746ac6a376418c995f9'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:24.767422 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea827ca20514746ac6a376418c995f9'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:24.767982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea827ca20514746ac6a376418c995f9'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:24.781862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea827ca20514746ac6a376418c995f9'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:24.788271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1371/2731] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:24 2022] DELETE /identity/v3/users/0ea827ca20514746ac6a376418c995f9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:24.792685 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:24.793158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:24.793264 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:24.812054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:24.814145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:24.844173 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:24.872566 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1361/2732] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:24.883165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:24.884591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:24.943354 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de1c-3e40-4c3c-af30-e63dfa4ed15a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:24.946951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:24.947550 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:24.947831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:24.948100 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:24.958420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:24.959911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:24.970154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1372/2733] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:25.393643 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:25.395229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:25.409831 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e4b6-0c18-4ef1-a227-de210433c9c0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:25.415716 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:25.417104 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:25.417660 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:25.418159 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] PATH_INFO: `/v3/projects/78ce215faed34873a421024403cd84fd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:25.429667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ce215faed34873a421024403cd84fd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:25.429667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:25.606164 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ce215faed34873a421024403cd84fd', 'request_id': 'req-96e99540-f1e5-4280-b159-50b806b31235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:25.612022 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ce215faed34873a421024403cd84fd', 'request_id': 'req-96e99540-f1e5-4280-b159-50b806b31235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:25.746576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ce215faed34873a421024403cd84fd', 'request_id': 'req-96e99540-f1e5-4280-b159-50b806b31235'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:25.759356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] The token cache is being invalidate because project 78ce215faed34873a421024403cd84fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:25.759727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:25.762209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-96e99540-f1e5-4280-b159-50b806b31235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:25.762209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1362/2734] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:25 2022] DELETE /identity/v3/projects/78ce215faed34873a421024403cd84fd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:25.766788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:25.776986 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f020869-c535-49ad-92d8-3177b30881e2 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:25.815896 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:25.841182 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f2ae-8728-4590-bb3e-626261e7ce7d None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:25.841690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f2ae-8728-4590-bb3e-626261e7ce7d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:25.841993 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:25.842178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f2ae-8728-4590-bb3e-626261e7ce7d None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:25.842652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:25.842959 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:25.843232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] PATH_INFO: `/v3/users/b225c519454e4597a0719acd7ca070fc` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:25.844595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1363/2735] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 18:11:25.845022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b225c519454e4597a0719acd7ca070fc)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:25.847335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:25.850434 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:25.850713 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:25.851018 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:25.873402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] MFA Rules not processed for user `9ae3b9603f0b45cebed05cdeb0d50be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:25.874562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:25.934898 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1364/2736] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:11:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:25.948307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:25.949696 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:25.961137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3aefc-004b-4c1a-acdb-f19e219a2d3f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:25.964944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:25.965536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:25.965807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:25.966071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:25.974416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:25.975865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c3236-0058-443f-9480-dbe66d435882 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:25.983479 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1365/2737] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:11:26.018304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b225c519454e4597a0719acd7ca070fc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.025474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b225c519454e4597a0719acd7ca070fc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.067343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854cb2-ca4c-4df3-93ac-0bb00e2bad24 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:26.070010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854cb2-ca4c-4df3-93ac-0bb00e2bad24 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:26.070010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854cb2-ca4c-4df3-93ac-0bb00e2bad24 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:26.070010 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1366/2738] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 18:11:26.073760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:26.074033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:26.074300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:26.089206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b225c519454e4597a0719acd7ca070fc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.089862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b225c519454e4597a0719acd7ca070fc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.095343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:26.098797 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:26.104675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b225c519454e4597a0719acd7ca070fc'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.111201 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1373/2739] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:25 2022] DELETE /identity/v3/users/b225c519454e4597a0719acd7ca070fc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:26.147874 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:26.168730 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1367/2740] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:11:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:26.180126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:26.181571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:26.242374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bc35-337a-48d1-8656-00217b94d331 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:26.246088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:26.246689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:26.247012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:26.247319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:26.317664 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:26.323729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:26.325264 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:26.339126 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1374/2741] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:26.576258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:26.577702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:26.592504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c4707-98e4-4941-9a34-0bbb77fa067f None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:26.648740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:26.649369 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:26.649647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:26.649916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] PATH_INFO: `/v3/projects/195ebf20f955447cbef67924f75d73a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:26.651062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195ebf20f955447cbef67924f75d73a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:26.652960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:26.770341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195ebf20f955447cbef67924f75d73a4', 'request_id': 'req-8b54249e-4eba-4f45-9f98-92e422e0b5c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.776178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195ebf20f955447cbef67924f75d73a4', 'request_id': 'req-8b54249e-4eba-4f45-9f98-92e422e0b5c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.847260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195ebf20f955447cbef67924f75d73a4', 'request_id': 'req-8b54249e-4eba-4f45-9f98-92e422e0b5c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.860120 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] The token cache is being invalidate because project 195ebf20f955447cbef67924f75d73a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:26.860413 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.861066 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:26.862708 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1368/2742] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:26 2022] DELETE /identity/v3/projects/195ebf20f955447cbef67924f75d73a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:26.866741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:26.878017 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332641-76f6-472c-993e-164f4e1fcf1a service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:26.939700 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:26.940406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:26.940611 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:26.940886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] PATH_INFO: `/v3/users/72083a94fe55447588af33a970b70611` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:26.942003 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=72083a94fe55447588af33a970b70611)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:26.943938 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:27.172610 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72083a94fe55447588af33a970b70611'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.180099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72083a94fe55447588af33a970b70611'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.254488 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72083a94fe55447588af33a970b70611'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.255180 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72083a94fe55447588af33a970b70611'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.268170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-75051d79-f7ab-45a0-bf35-cb28d815bcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72083a94fe55447588af33a970b70611'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.280184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1375/2743] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:26 2022] DELETE /identity/v3/users/72083a94fe55447588af33a970b70611 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:27.747691 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:27.750198 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:27.786632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54249e-4eba-4f45-9f98-92e422e0b5c4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:27.862342 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:27.863078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:27.863313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:27.863723 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] PATH_INFO: `/v3/projects/b223f556650b40f8aba739bf7346c67c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:27.865711 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b223f556650b40f8aba739bf7346c67c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:27.868282 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:27.894209 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:27.980459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b223f556650b40f8aba739bf7346c67c', 'request_id': 'req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:27.986141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b223f556650b40f8aba739bf7346c67c', 'request_id': 'req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:28.087629 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b223f556650b40f8aba739bf7346c67c', 'request_id': 'req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:28.100786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] The token cache is being invalidate because project b223f556650b40f8aba739bf7346c67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:28.101076 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:28.101729 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-3c8fb7ce-9bb8-469c-8303-a9461bfe0d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:28.103338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1369/2744] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:27 2022] DELETE /identity/v3/projects/b223f556650b40f8aba739bf7346c67c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:28.108312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.108802 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.108964 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.130630 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:28.131893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:28.239435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1376/2745] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:28.247644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.248002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.248339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.269927 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:28.271253 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:28.282706 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1370/2746] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:28.286866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.297172 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd133c-562b-4a5f-a1c3-4a83cd904c8f None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.315246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.315246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.315246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.315246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.316555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:11:28.316555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.316555 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.322974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1377/2747] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:11:28.327770 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.341986 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258aa0-d854-488c-bb2a-556483a78e3b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.347539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.348145 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.348454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.348775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.349405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.351335 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.478154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1371/2748] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:28 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:28.482361 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.487997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:28.493370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a46a-3b8d-4cbf-bbf8-0eacdcd9e2c1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.550652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.551574 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.552059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.552333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.553689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.555750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.670607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1378/2749] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:28 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:28.675028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.686043 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90969-fc41-4222-9710-e6ab5d9a3609 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.691896 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.692529 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.692806 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.693094 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.698807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.700984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.713268 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1372/2750] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:28.717821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.728717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e25bc-5345-471d-9109-0d728206bf73 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.735503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.737974 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.738316 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.738602 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.739400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.750571 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf97f-acbe-422f-860d-72182e23aeb6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.756971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1379/2751] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:28.759394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:28.770546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f660-0208-4de7-a74b-af594729efdc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:28.775554 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:28.776227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.776488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.776785 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] PATH_INFO: `/v3/projects/0b4e73aab1284632bf588504733f1b67/users/2c7926e4320f4e28adc951606e26c920/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.792772 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4e73aab1284632bf588504733f1b67, user_id=2c7926e4320f4e28adc951606e26c920, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:28.795488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:28.895698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1373/2752] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:28 2022] PUT /identity/v3/projects/0b4e73aab1284632bf588504733f1b67/users/2c7926e4320f4e28adc951606e26c920/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:28.907656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:28.908103 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:28.908391 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:28.943334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] MFA Rules not processed for user `2c7926e4320f4e28adc951606e26c920`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:28.944614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:29.021016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1380/2753] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:29.024388 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.093899 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0298d-2088-44c1-92c3-4899f11634da admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.098924 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.099536 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.099818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.100091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.100742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.102647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.198932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1374/2754] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:29 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:29.203958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.215506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f416e-6fb5-4fd2-a7d1-acc8a94a556d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.278861 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.279478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.280037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.280312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.281097 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.283744 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.357093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:29.366208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1381/2755] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:29 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:29.369337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.381304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7796-1aef-46bf-b948-b2a06bf2e2b4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.388456 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.389393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.389872 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.390391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.396889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.396889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.405498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1375/2756] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:29.410357 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.420794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5363a2-3101-484d-9835-00b4b77fa7e2 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.426619 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.429285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.429285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.429285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.429285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.430400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00c4dd-ef19-4556-b9c8-02e07112d2da admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.442038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1382/2757] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:29.446155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.458239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35f0e8-2403-447e-bd7e-2ab90d38c949 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.463160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.463818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.464099 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.464371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] PATH_INFO: `/v3/projects/41cf9010e594408f9601c77ccaf3be5a/users/ac07a7ac259449a8a1e1a0b350f0fbe6/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.480655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41cf9010e594408f9601c77ccaf3be5a, user_id=ac07a7ac259449a8a1e1a0b350f0fbe6, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.483353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.486469 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:29.683826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1376/2758] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:29 2022] PUT /identity/v3/projects/41cf9010e594408f9601c77ccaf3be5a/users/ac07a7ac259449a8a1e1a0b350f0fbe6/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:29.710187 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.710454 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.710749 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.739672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] MFA Rules not processed for user `ac07a7ac259449a8a1e1a0b350f0fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:29.746383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:29.805858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1383/2759] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:29.810331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:29.875355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875eee2-01a8-47de-97af-84af036e8491 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:29.882081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:29.883414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:29.884129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:29.884400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:29.885166 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:29.887392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:29.999199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1377/2760] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:29 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:30.008042 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.015484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41495f1d-3df9-42f6-bb76-5245a19ac116 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.080153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.080757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.081035 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.081313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.081965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.084166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.180228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1384/2761] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:30 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:30.184157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.195163 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2330e8-0e0e-41cf-95da-c1c9c61f4b04 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.200031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.200624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.201151 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.201409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.202049 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.204329 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.215249 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1378/2762] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:30.220247 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.230146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c89ae-9df3-4fd8-b3c0-f8d44b305a52 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.235413 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.236049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.236328 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.236669 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] PATH_INFO: `/v3/projects/56257352d6eb4afd9d53d6116065c629/users/61ad941014454b0eb3e21557d4bcf5b5/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.251162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56257352d6eb4afd9d53d6116065c629, user_id=61ad941014454b0eb3e21557d4bcf5b5, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.253932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.317004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1385/2763] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:30 2022] PUT /identity/v3/projects/56257352d6eb4afd9d53d6116065c629/users/61ad941014454b0eb3e21557d4bcf5b5/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:30.321168 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.331242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211297e0-891a-4576-83a8-513dbf738e49 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.387869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.388463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.388737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.389004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.389630 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.391725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a36c0-58e3-47ad-b192-db086d3daa68 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.401288 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1379/2764] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:30.405577 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.416874 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb2e-26db-4426-8691-04ea7459fd48 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.421470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.423169 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.423448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.423723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] PATH_INFO: `/v3/projects/56257352d6eb4afd9d53d6116065c629/users/61ad941014454b0eb3e21557d4bcf5b5/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.425656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56257352d6eb4afd9d53d6116065c629, user_id=61ad941014454b0eb3e21557d4bcf5b5, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.428365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.438801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1386/2765] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:30 2022] PUT /identity/v3/projects/56257352d6eb4afd9d53d6116065c629/users/61ad941014454b0eb3e21557d4bcf5b5/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:11:30.448761 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.449046 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.449319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.477937 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] MFA Rules not processed for user `61ad941014454b0eb3e21557d4bcf5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:30.484671 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:30.527600 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:30.546153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1380/2766] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:30.557624 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:30.559377 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:30.595446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:30.620723 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c528-8708-4414-b502-5e6a7e0b0de1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:30.625746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:30.625746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:30.625746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:30.626095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:30.684551 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:30.685999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:30.695942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1387/2767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:32.677028 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:32.678565 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:32.695612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5dd7d-04c7-41c7-96d7-670a4b537fd4 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:32.699803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:32.700631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:32.701202 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:32.701642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:32.773513 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:32.775244 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:32.787377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1381/2768] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:34.477788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:34.486923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2893b9-64d0-42a3-9174-f9940a1170b8 service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:34.490651 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:34.491274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:34.491552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:34.491821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:34.501330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:34.502756 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f5960-cf79-4155-9dbb-e521fc6ffb81 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:34.512044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1388/2769] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:39.210877 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:39.318585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330d49-3a0d-47c4-92b2-7a108b6b0eab service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:39.323396 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:39.327056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:39.327056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:39.327056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] PATH_INFO: `/v3/users/2c7926e4320f4e28adc951606e26c920` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:39.327056 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7926e4320f4e28adc951606e26c920)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:39.328512 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:39.359344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905753-4652-4047-9ea9-38cf19631893 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:39.359915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905753-4652-4047-9ea9-38cf19631893 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:39.359915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905753-4652-4047-9ea9-38cf19631893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:39.388561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-0a905753-4652-4047-9ea9-38cf19631893 None None] MFA Rules not processed for user `8181a309e17b44e28df51db202225427`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:39.389770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0a905753-4652-4047-9ea9-38cf19631893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:39.448109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1389/2770] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:39.516181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7926e4320f4e28adc951606e26c920'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:39.517382 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:39.523589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7926e4320f4e28adc951606e26c920'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:39.603031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7926e4320f4e28adc951606e26c920'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:39.616464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7926e4320f4e28adc951606e26c920'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:39.617110 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7926e4320f4e28adc951606e26c920'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:39.623205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1382/2771] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:39 2022] DELETE /identity/v3/users/2c7926e4320f4e28adc951606e26c920 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:39.628640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:39.628924 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:39.629200 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:39.668849 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:39.670089 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:39.720283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=100 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:39.736163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1390/2772] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:39.746065 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:39.747598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:39.829555 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6425ff6-4042-49a1-9fc8-88fe3ec1bf75 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:39.833475 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:39.834073 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:39.834347 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:39.834615 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:39.844965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:39.846451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:39.856491 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1383/2773] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:40.320044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:40.321570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:40.334292 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59931ccd-7cc9-4cf6-82ad-04a8506842f8 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:40.339304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:40.339957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:40.343704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:40.343704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] PATH_INFO: `/v3/projects/0b4e73aab1284632bf588504733f1b67` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:40.343704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4e73aab1284632bf588504733f1b67)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:40.343704 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:40.443945 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4e73aab1284632bf588504733f1b67', 'request_id': 'req-1ad8b7d3-d382-4270-b837-d545ee258d27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.450346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4e73aab1284632bf588504733f1b67', 'request_id': 'req-1ad8b7d3-d382-4270-b837-d545ee258d27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.456067 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4e73aab1284632bf588504733f1b67', 'request_id': 'req-1ad8b7d3-d382-4270-b837-d545ee258d27'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.527456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] The token cache is being invalidate because project 0b4e73aab1284632bf588504733f1b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:40.530253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.530253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.530253 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1391/2774] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:40 2022] DELETE /identity/v3/projects/0b4e73aab1284632bf588504733f1b67 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:40.534149 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:40.544136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d81e4-e5e8-40fe-b7c3-6adb2725fc94 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:40.602519 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:40.603169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:40.603447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:40.603714 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] PATH_INFO: `/v3/users/ac07a7ac259449a8a1e1a0b350f0fbe6` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:40.604835 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac07a7ac259449a8a1e1a0b350f0fbe6)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:40.606758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:40.821786 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac07a7ac259449a8a1e1a0b350f0fbe6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.827336 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:40.829447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac07a7ac259449a8a1e1a0b350f0fbe6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.926915 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac07a7ac259449a8a1e1a0b350f0fbe6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.939909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac07a7ac259449a8a1e1a0b350f0fbe6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.940611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac07a7ac259449a8a1e1a0b350f0fbe6'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:40.946448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1384/2775] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:40 2022] DELETE /identity/v3/users/ac07a7ac259449a8a1e1a0b350f0fbe6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:41.376996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:41.378515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:41.394127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8b7d3-d382-4270-b837-d545ee258d27 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:41.454595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:41.455485 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:41.455596 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:41.455862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] PATH_INFO: `/v3/projects/41cf9010e594408f9601c77ccaf3be5a` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:41.456988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=41cf9010e594408f9601c77ccaf3be5a)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:41.459192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:41.576415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41cf9010e594408f9601c77ccaf3be5a', 'request_id': 'req-e4372c77-0cd1-4953-9ea7-a75530bb7fad'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.583761 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41cf9010e594408f9601c77ccaf3be5a', 'request_id': 'req-e4372c77-0cd1-4953-9ea7-a75530bb7fad'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.589512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41cf9010e594408f9601c77ccaf3be5a', 'request_id': 'req-e4372c77-0cd1-4953-9ea7-a75530bb7fad'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.637312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] The token cache is being invalidate because project 41cf9010e594408f9601c77ccaf3be5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:41.637601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.638228 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.640032 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1392/2776] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:41 2022] DELETE /identity/v3/projects/41cf9010e594408f9601c77ccaf3be5a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:41.644431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:41.645900 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:41.659141 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d17e-8334-4fc1-9fb1-7a59e5f571a2 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:41.717916 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:41.718546 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:41.718870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:41.719295 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] PATH_INFO: `/v3/users/61ad941014454b0eb3e21557d4bcf5b5` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:41.720516 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ad941014454b0eb3e21557d4bcf5b5)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:41.722420 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:41.937633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ad941014454b0eb3e21557d4bcf5b5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.945525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ad941014454b0eb3e21557d4bcf5b5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:41.995628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ad941014454b0eb3e21557d4bcf5b5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.009291 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ad941014454b0eb3e21557d4bcf5b5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.009958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-b91fb3ed-c89d-4bab-bde0-ac8437170af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ad941014454b0eb3e21557d4bcf5b5'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.016035 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1385/2777] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:41 2022] DELETE /identity/v3/users/61ad941014454b0eb3e21557d4bcf5b5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:11:42.450525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:42.451971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:42.462443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:42.466797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372c77-0cd1-4953-9ea7-a75530bb7fad admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:42.532711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:42.533380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:42.533675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:42.533996 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] PATH_INFO: `/v3/projects/56257352d6eb4afd9d53d6116065c629` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:42.535212 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56257352d6eb4afd9d53d6116065c629)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:42.537211 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:42.648780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56257352d6eb4afd9d53d6116065c629', 'request_id': 'req-af755443-efe8-4390-a815-b5ce8d43c68a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.655109 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56257352d6eb4afd9d53d6116065c629', 'request_id': 'req-af755443-efe8-4390-a815-b5ce8d43c68a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.660825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56257352d6eb4afd9d53d6116065c629', 'request_id': 'req-af755443-efe8-4390-a815-b5ce8d43c68a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.757767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] The token cache is being invalidate because project 56257352d6eb4afd9d53d6116065c629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:42.758107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.758779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-af755443-efe8-4390-a815-b5ce8d43c68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:42.760318 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1393/2778] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:42 2022] DELETE /identity/v3/projects/56257352d6eb4afd9d53d6116065c629 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:42.765557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:42.766162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:42.766162 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:42.816227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:42.817441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:42.838819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:42.878293 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1386/2779] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:11:42.886313 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344076-a6ac-405c-900e-482366eb286b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:42.886601 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344076-a6ac-405c-900e-482366eb286b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:42.887120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344076-a6ac-405c-900e-482366eb286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:42.908312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-c9344076-a6ac-405c-900e-482366eb286b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:42.909643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c9344076-a6ac-405c-900e-482366eb286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:42.917958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1394/2780] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:42.921970 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:42.937055 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a411129-1aef-4fde-b61b-ae4986045115 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:42.939801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:42.940421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:42.940699 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:42.941108 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:42.941764 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:11:42.942064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:42.943703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:42.960274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1387/2781] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:11:42.961509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9344076-a6ac-405c-900e-482366eb286b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:42.973914 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9344076-a6ac-405c-900e-482366eb286b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:42.978970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:42.980083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:42.980467 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:42.980839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:42.982084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:42.984230 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.131703 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1395/2782] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:11:42 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:43.135906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.146948 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101d273-0bb1-4c61-920e-fa113c61247d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.213468 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.214424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.214424 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.214631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.216058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.218701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.289216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1388/2783] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:11:43 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:11:43.293303 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.304841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7536111-2486-409e-8b41-a72193bc5efa admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.309565 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.310164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.310436 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.310702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.311385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.313545 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.323867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1396/2784] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:11:43.327801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.338796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336092-65cf-4fc3-96f4-3c17f122c882 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.343482 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.358208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.358208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.358208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.358208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.358208 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0131a62-838d-4e0f-985c-7fd503fbb215 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.359011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1389/2785] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:11:43.362989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.373278 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440003c-09b2-4b73-9b2f-70142469be8b admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.379141 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.379819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.380076 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.380346 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] PATH_INFO: `/v3/projects/33013021fad64dfd9c1e8ce9f6f6a79d/users/f4c8c318397e4ead8fd21c36368686c4/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.395988 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33013021fad64dfd9c1e8ce9f6f6a79d, user_id=f4c8c318397e4ead8fd21c36368686c4, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.398821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.502293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1397/2786] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:11:43 2022] PUT /identity/v3/projects/33013021fad64dfd9c1e8ce9f6f6a79d/users/f4c8c318397e4ead8fd21c36368686c4/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:43.513712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.514031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.514300 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.546115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] MFA Rules not processed for user `f4c8c318397e4ead8fd21c36368686c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:43.546115 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:43.614758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1390/2787] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:43.626302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.628083 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:43.662976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:43.691041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84240-ae4d-4f48-ad8c-ed3ce37fc81c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.694709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.695689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.695689 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.695911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.705239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.707315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a55ab5-e182-44d4-a3e0-1a3ed1e23b3a service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:43.730157 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1398/2788] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:43.746427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:43.773694 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:43.812275 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863f5f-25e7-485b-8407-26f523d71555 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:43.817051 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:43.817687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:43.817960 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:43.818227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] PATH_INFO: `/v3/users/f4c8c318397e4ead8fd21c36368686c4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:43.819377 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c8c318397e4ead8fd21c36368686c4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:43.821280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:44.006550 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c8c318397e4ead8fd21c36368686c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:44.015229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c8c318397e4ead8fd21c36368686c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:44.117569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c8c318397e4ead8fd21c36368686c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:44.131118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c8c318397e4ead8fd21c36368686c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:44.131813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c8c318397e4ead8fd21c36368686c4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:44.138080 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1391/2789] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:11:43 2022] DELETE /identity/v3/users/f4c8c318397e4ead8fd21c36368686c4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:44.144016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:44.144990 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:44.145312 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:44.165645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:11:44.166911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:44.231590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1399/2790] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:11:44.241765 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:44.243237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:44.303760 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6eb80-8830-4679-9b01-e9ed6ef4f574 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:44.307698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:44.308303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:44.308585 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:44.308856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:44.319024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:44.320517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:44.330618 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1392/2791] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:45.015731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:45.017833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:45.030871 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4165b4d-b70e-415b-a8cc-e882c249cbcd None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:45.037270 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:45.037950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:45.038229 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:45.038502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] PATH_INFO: `/v3/projects/33013021fad64dfd9c1e8ce9f6f6a79d` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:45.039670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33013021fad64dfd9c1e8ce9f6f6a79d)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:45.041670 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:45.176490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33013021fad64dfd9c1e8ce9f6f6a79d', 'request_id': 'req-2a4f21a5-3c52-4252-9983-aa4151111102'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:45.182709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33013021fad64dfd9c1e8ce9f6f6a79d', 'request_id': 'req-2a4f21a5-3c52-4252-9983-aa4151111102'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:45.188734 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33013021fad64dfd9c1e8ce9f6f6a79d', 'request_id': 'req-2a4f21a5-3c52-4252-9983-aa4151111102'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:45.271566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] The token cache is being invalidate because project 33013021fad64dfd9c1e8ce9f6f6a79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:11:45.271779 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:45.272390 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:11:45.273875 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1400/2792] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:11:45 2022] DELETE /identity/v3/projects/33013021fad64dfd9c1e8ce9f6f6a79d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:11:51.937826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:11:51.940130 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:52.005958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:52.066984 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd327-da1c-4921-b471-d9b8fda5437f service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:11:52.132821 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:11:52.133441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:11:52.133715 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:11:52.133982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:11:52.135891 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:11:52.149248 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:11:52.150871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d45eb-4611-40e9-8fc6-4821719c94e1 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:11:52.161577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1393/2793] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:11:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:11:55.268271 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:02.157001 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=54 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:47.394533 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:12:47.396079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:12:47.496906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f21a5-3c52-4252-9983-aa4151111102 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:12:47.501979 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:12:47.502581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:12:47.502892 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:12:47.503171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:12:47.504951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:12:47.517754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:12:47.519379 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:12:47.529775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1401/2794] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:12:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:12:48.821884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:12:48.822400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:12:48.822524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:12:48.851271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:12:48.853061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:12:48.909856 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1394/2795] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:12:49.098584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:12:49.100043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:12:49.172620 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec200ad9-03cb-4a14-aab9-241db5542ab9 service placement] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:12:49.177635 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:12:49.178268 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:12:49.178542 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:12:49.178845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:12:49.187167 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:12:49.188760 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:12:49.197099 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1402/2796] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:12:58.902858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=29 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:59.193575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=73 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:05.426138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:05.427647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:05.497790 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4121-3cdf-4fd3-9f5a-c8a4ee1d9f9c None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:05.502599 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:05.503242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:05.503518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:05.503783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] PATH_INFO: `/v3/users/616f058252c4486eb29f3d89857f15cd` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:05.504997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] RBAC: Authorizing `identity:delete_user(user_id=616f058252c4486eb29f3d89857f15cd)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:05.507143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:05.684221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616f058252c4486eb29f3d89857f15cd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:05.691212 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616f058252c4486eb29f3d89857f15cd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:05.761186 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616f058252c4486eb29f3d89857f15cd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:05.773573 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616f058252c4486eb29f3d89857f15cd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:05.774888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616f058252c4486eb29f3d89857f15cd'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:05.780572 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1395/2797] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:13:05 2022] DELETE /identity/v3/users/616f058252c4486eb29f3d89857f15cd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:13:06.009450 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:06.021736 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3da0d9-4324-4daf-8bb1-66608ab0069e service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:06.081075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:06.081696 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:06.081972 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:06.082243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] PATH_INFO: `/v3/projects/c678ef12fdc247d5b790d5af20481426` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:06.083371 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c678ef12fdc247d5b790d5af20481426)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:06.085539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:06.172941 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c678ef12fdc247d5b790d5af20481426', 'request_id': 'req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.179140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c678ef12fdc247d5b790d5af20481426', 'request_id': 'req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.185605 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c678ef12fdc247d5b790d5af20481426', 'request_id': 'req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.252705 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] The token cache is being invalidate because project c678ef12fdc247d5b790d5af20481426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:13:06.252999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.253662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.255196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1403/2798] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:13:06 2022] DELETE /identity/v3/projects/c678ef12fdc247d5b790d5af20481426 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:13:06.259855 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:06.261478 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:06.274462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be3a1-9e1a-4bdb-907e-e33004f2527f admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:06.336233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:06.337062 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:06.337348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:06.337607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] PATH_INFO: `/v3/users/f7b7136a987e4b93a5d176c2b00ead1c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:06.338759 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b7136a987e4b93a5d176c2b00ead1c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:06.340647 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:06.363214 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:06.528431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b7136a987e4b93a5d176c2b00ead1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.535493 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b7136a987e4b93a5d176c2b00ead1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.595631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b7136a987e4b93a5d176c2b00ead1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.608296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b7136a987e4b93a5d176c2b00ead1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.608946 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-624ebb54-013c-4469-b366-5d8deee9852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b7136a987e4b93a5d176c2b00ead1c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:06.614912 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1396/2799] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:13:06 2022] DELETE /identity/v3/users/f7b7136a987e4b93a5d176c2b00ead1c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:13:06.890786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:06.890786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:06.906440 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e58b-c90e-45cb-83ab-d84d293b6abb admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:06.981366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:06.982008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:06.982294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:06.982572 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] PATH_INFO: `/v3/projects/7cf2ddf895fa468aa96cc83b3158c976` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:06.983848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf2ddf895fa468aa96cc83b3158c976)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:06.985813 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:07.087976 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:07.101441 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf2ddf895fa468aa96cc83b3158c976', 'request_id': 'req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:07.108075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf2ddf895fa468aa96cc83b3158c976', 'request_id': 'req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:07.113778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf2ddf895fa468aa96cc83b3158c976', 'request_id': 'req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:07.123334 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c00bd-f60b-42f1-a92b-587412d14256 None None] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:07.123682 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c00bd-f60b-42f1-a92b-587412d14256 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:07.128061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c00bd-f60b-42f1-a92b-587412d14256 None None] PATH_INFO: `/` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:07.128061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1397/2800] 10.222.0.58 () {54 vars in 921 bytes} [Thu Sep 1 18:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 18:13:07.130143 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382c1e-a49c-4fc8-972e-739f1a7b8a96 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:07.130426 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382c1e-a49c-4fc8-972e-739f1a7b8a96 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:07.130702 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382c1e-a49c-4fc8-972e-739f1a7b8a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:07.153592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-69382c1e-a49c-4fc8-972e-739f1a7b8a96 None None] MFA Rules not processed for user `716bdc59d9eb46398492fdea1759ed7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:13:07.154863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-69382c1e-a49c-4fc8-972e-739f1a7b8a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:07.207617 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] The token cache is being invalidate because project 7cf2ddf895fa468aa96cc83b3158c976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:13:07.208603 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:07.208977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:13:07.210452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1404/2801] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:13:06 2022] DELETE /identity/v3/projects/7cf2ddf895fa468aa96cc83b3158c976 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:13:07.224784 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1398/2802] 10.222.0.58 () {58 vars in 1018 bytes} [Thu Sep 1 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:13:07.237718 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:07.239277 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:07.307934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6e0a1-7b69-4d5e-a3c4-f85beb66df6f admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:07.311899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c40c8bb3b24e07b3189f84acd4ca02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:07.312750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:07.313031 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:07.313306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:07.325040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:07.326554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:07.339443 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1405/2803] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:13:10.023783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02f04-1bf7-4aba-9c69-ef21e3cc737b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:10.024243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02f04-1bf7-4aba-9c69-ef21e3cc737b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:10.024353 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02f04-1bf7-4aba-9c69-ef21e3cc737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:10.043414 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-9dc02f04-1bf7-4aba-9c69-ef21e3cc737b None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:13:10.044631 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-9dc02f04-1bf7-4aba-9c69-ef21e3cc737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:10.100488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1399/2804] 10.222.0.58 () {58 vars in 1009 bytes} [Thu Sep 1 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:13:10.113400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:10.114709 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:10.185640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c411f-b6a6-4150-b7e2-4d7e1f763028 service glance] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:10.191012 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:10.191890 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:10.192911 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:10.193189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:10.202482 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:10.204108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:10.212825 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1406/2805] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:13:20.093607 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=7,keystone:SELECT=76,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:20.208821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=70,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:24.871779 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06402-543f-4154-897c-86705b5173e8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:24.872254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06402-543f-4154-897c-86705b5173e8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:24.872438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06402-543f-4154-897c-86705b5173e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:24.891446 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-60c06402-543f-4154-897c-86705b5173e8 None None] MFA Rules not processed for user `4461438f42034a62ae0b8923867c868c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:13:24.892642 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-60c06402-543f-4154-897c-86705b5173e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:24.899720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1400/2806] 10.222.0.58 () {58 vars in 967 bytes} [Thu Sep 1 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:13:24.912541 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:24.923925 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3cb28-da3b-4935-853c-12b7d8bced72 service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:24.928975 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86f47c546d1b47d69252eaa11b5a3f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:24.929560 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:24.929836 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:24.930108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:24.938146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:24.939880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:24.948112 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1407/2807] 10.222.0.58 () {60 vars in 1384 bytes} [Thu Sep 1 18:13:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 18:13:34.885737 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:34.945178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=6 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:57.529181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c06402-543f-4154-897c-86705b5173e8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:57.530718 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-60c06402-543f-4154-897c-86705b5173e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:57.607361 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c06402-543f-4154-897c-86705b5173e8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:57.610876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:57.611465 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:57.611738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:57.612002 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:57.613705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:57.627418 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:57.628819 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:57.639997 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1401/2808] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:13:58.844090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:13:58.854034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e7a3f-b36f-49f9-a463-2438ec5a6c75 service swift] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:13:58.857616 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:13:58.858202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:13:58.858481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:13:58.858778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:13:58.860507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:13:58.874638 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:13:58.876108 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:13:58.887934 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1408/2809] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:00.028306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:00.028306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:00.043538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70ab0-9cd6-4efd-9f98-b30f04694a95 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:00.049341 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:00.049942 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:00.050348 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:00.050547 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:00.053125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:00.113082 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:00.114675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:00.124695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1402/2810] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:14:04.769130 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:04.770506 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:04.781858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40031-e868-4f87-bf68-47d55534b6d8 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:04.785419 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:04.786004 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:04.786279 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:04.786578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:04.788909 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:04.851474 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:04.852935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:04.862913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1409/2811] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:08.701459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:08.703102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:08.718993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea953c-ef43-4bae-94fe-6a26f75e5ab7 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:08.723564 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:08.724518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:08.724817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:08.726763 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] PATH_INFO: `/v3/users/8181a309e17b44e28df51db202225427` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:08.727982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8181a309e17b44e28df51db202225427)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:08.729905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:08.922998 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8181a309e17b44e28df51db202225427'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:08.930383 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8181a309e17b44e28df51db202225427'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:08.994791 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8181a309e17b44e28df51db202225427'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.006017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:09.008477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8181a309e17b44e28df51db202225427'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.009105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-5e18cab0-1d92-4cfc-b5ea-3921e419f340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8181a309e17b44e28df51db202225427'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.014903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1403/2812] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:14:08 2022] DELETE /identity/v3/users/8181a309e17b44e28df51db202225427 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:14:09.270333 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:09.283520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684b2e-bf36-44f8-ba62-2987a9526919 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:09.343192 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:09.343820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.344095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.344362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] PATH_INFO: `/v3/projects/f4bdb1f8bb1d44469c93bd454d9d2897` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.345470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bdb1f8bb1d44469c93bd454d9d2897)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:09.347408 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:09.451275 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bdb1f8bb1d44469c93bd454d9d2897', 'request_id': 'req-cb69158f-2028-40a2-9430-c61a43d3479d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.457674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bdb1f8bb1d44469c93bd454d9d2897', 'request_id': 'req-cb69158f-2028-40a2-9430-c61a43d3479d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.464117 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bdb1f8bb1d44469c93bd454d9d2897', 'request_id': 'req-cb69158f-2028-40a2-9430-c61a43d3479d'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.537497 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] The token cache is being invalidate because project f4bdb1f8bb1d44469c93bd454d9d2897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:14:09.541248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.541248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cb69158f-2028-40a2-9430-c61a43d3479d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:14:09.541248 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1410/2813] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:14:09 2022] DELETE /identity/v3/projects/f4bdb1f8bb1d44469c93bd454d9d2897 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:14:09.544906 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.545191 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.545464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.565463 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:14:09.566677 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:09.625591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1404/2814] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:14:09.634330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.634615 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.634923 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.655484 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:14:09.656805 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:09.665037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1411/2815] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:14:09.669304 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:09.679088 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7940d9-2f2c-4214-8d8e-b640e415ef81 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:09.683688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:09.684289 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.684569 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.684842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.685488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:14:09.685793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:09.687437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:09.702705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1405/2816] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:14:09.707028 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:09.713735 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:09.717504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8797d-ac76-4528-afcb-cc4be5f79d1c None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:09.722174 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:09.722796 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.732060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.732060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.732060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:09.732060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:09.819636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1412/2817] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:14:09 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:14:09.823777 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:09.834627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da510-6f76-4de1-b64c-0b29ac923609 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:09.892701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:09.893313 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:09.893624 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:09.893897 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:09.894543 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:09.897233 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:09.995739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1406/2818] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:14:09 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:14:09.999815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:10.011481 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b469b-6216-488a-bb97-c7eae4eba50c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:10.016215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:10.016824 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:10.017156 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:10.017465 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:10.018106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:10.019737 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:10.030702 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1413/2819] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:14:10.034720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:10.044688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917999d-3bfc-48bd-9df1-4d13f654207d admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:10.049322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:10.049944 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:10.050223 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:10.050490 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:10.051154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:10.053258 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305070ee-b5cb-4ec7-8e8f-70bbd0fefd35 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:10.063801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1407/2820] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:14:10.069250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:10.079365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd59d4-2cb8-4712-a88e-3c006acbb655 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:10.084590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:10.085503 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:10.085765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:10.086040 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] PATH_INFO: `/v3/projects/142d1fa384b646d5b8f921304e432ac2/users/096d62efdf83477bb21e3ce26e576b1a/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:10.100999 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=142d1fa384b646d5b8f921304e432ac2, user_id=096d62efdf83477bb21e3ce26e576b1a, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:10.103672 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:10.172024 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1414/2821] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:14:10 2022] PUT /identity/v3/projects/142d1fa384b646d5b8f921304e432ac2/users/096d62efdf83477bb21e3ce26e576b1a/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:14:10.177621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f275b-9ecd-4e05-a44b-b26fcca39add None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:10.178013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f275b-9ecd-4e05-a44b-b26fcca39add None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:10.178284 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f275b-9ecd-4e05-a44b-b26fcca39add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:10.198994 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-987f275b-9ecd-4e05-a44b-b26fcca39add None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:14:10.200192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-987f275b-9ecd-4e05-a44b-b26fcca39add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:10.250242 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:10.259472 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1408/2822] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:14:10.269198 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:10.271051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:10.330087 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2068-c58a-4fa9-b0bb-1a6ac0c62c9c admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:10.334049 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:10.334606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:10.335176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:10.335445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:10.344325 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:10.345751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:10.356487 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1415/2823] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:14:15.513199 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07448-62c8-4913-9585-f87580765a1b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:15.513665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07448-62c8-4913-9585-f87580765a1b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:15.513665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07448-62c8-4913-9585-f87580765a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:15.551721 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d0e07448-62c8-4913-9585-f87580765a1b None None] MFA Rules not processed for user `096d62efdf83477bb21e3ce26e576b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:14:15.554246 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d0e07448-62c8-4913-9585-f87580765a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:15.627467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1409/2824] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:14:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:14:15.644206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:15.645699 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:15.725794 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3237a6b-5915-438d-8a4b-1ada87920730 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:15.731374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:15.731985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:15.732265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:15.732536 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:15.742129 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:15.743831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:15.753420 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1416/2825] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:14:18.123435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:18.123935 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:18.124031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:18.144612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] MFA Rules not processed for user `096d62efdf83477bb21e3ce26e576b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:14:18.145742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:18.153871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1410/2826] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:14:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:14:18.534421 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:18.536334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:18.549470 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f412-20f7-4058-855f-050ad9fed701 service nova] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:18.554531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:18.555173 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:18.555461 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:18.555727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:18.557471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:18.581079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:18.582682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:18.592982 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1417/2827] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:19.027719 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:19.029239 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:19.109686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcaa3b-014f-4bc0-84b9-f4caf39fb261 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:19.115165 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:19.115804 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:19.116205 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:19.116480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:19.118375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:19.131596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:19.133179 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:19.144943 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1411/2828] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:22.517913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:22.527293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cff1-d081-4c61-9b24-8effedb44efa service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:22.537186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:22.537186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:22.537186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:22.537186 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:22.538426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:22.545491 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:22.546946 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843b755-0ecf-41f0-a224-aedab393099f service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:22.551712 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:22.556427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1418/2829] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:29.140243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=67 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:34.352278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:14:34.365152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac4dec-a8f3-4605-ba2e-4cf056a1c6f3 service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:14:34.370968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:14:34.371568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:14:34.371844 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:14:34.372114 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:14:34.373840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:14:34.389192 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:14:34.390817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:14:34.403299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1412/2830] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:14:44.398243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=6 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:15.561311 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3759-c106-4693-9ad3-1219922ecbd6 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:15:15.561852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3759-c106-4693-9ad3-1219922ecbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:15:15.561852 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3759-c106-4693-9ad3-1219922ecbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:15:15.582458 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-b0cb3759-c106-4693-9ad3-1219922ecbd6 None None] MFA Rules not processed for user `096d62efdf83477bb21e3ce26e576b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:15:15.591866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-b0cb3759-c106-4693-9ad3-1219922ecbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:15:15.591866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1419/2831] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:15:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:15:25.576065 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:26.191531 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:15:26.193078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:15:26.207121 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afc44-e5a6-4c8f-a2d3-38805100577b service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:15:26.213280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:15:26.213822 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:15:26.214101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:15:26.214406 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:15:26.216144 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:15:26.228962 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:15:26.230528 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:15:26.241167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1413/2832] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:15:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:15:36.236767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=6 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:18.529716 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99d4b-c2a3-4c09-a063-58de42bd2538 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:16:18.530234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99d4b-c2a3-4c09-a063-58de42bd2538 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:16:18.530234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99d4b-c2a3-4c09-a063-58de42bd2538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:16:18.550384 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-6da99d4b-c2a3-4c09-a063-58de42bd2538 None None] MFA Rules not processed for user `096d62efdf83477bb21e3ce26e576b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:16:18.551525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-6da99d4b-c2a3-4c09-a063-58de42bd2538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:16:18.559140 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1420/2833] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:16:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:16:28.543873 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:17:10.628579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:17:10.640628 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b59fd3-748f-4300-b337-6dcf1481f2dc service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:17:10.646174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:17:10.646966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:17:10.647105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:17:10.647376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:17:10.649140 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:17:10.662210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:17:10.663813 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:17:10.674807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1414/2834] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:17:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:17:15.843002 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:17:15.843595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:17:15.843595 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:17:15.862845 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] MFA Rules not processed for user `096d62efdf83477bb21e3ce26e576b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:17:15.864044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:17:15.871676 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1421/2835] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:17:16.181793 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:17:16.192467 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944283b9-f000-47e1-b8c0-1e40ccb80aa1 service nova] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:17:16.196092 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:17:16.196683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:17:16.196959 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:17:16.197226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:17:16.198958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:17:16.209071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:17:16.210476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:17:16.219266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1415/2836] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:17:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:17:25.857365 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:17:26.215441 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=12 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:17:53.359265 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:17:53.360751 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:17:53.376731 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557680-79d8-4ab2-8861-b627cf4a7151 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:17:53.381872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:17:53.382460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:17:53.382809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:17:53.383090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:17:53.384786 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:17:53.396425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:17:53.398043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:17:53.408258 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1422/2837] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:17:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:03.403821 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=6 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:24.844372 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:24.859423 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422488c1-f27d-46d5-9cdd-445f9e9a04a9 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:24.865580 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:24.866436 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:24.867587 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:24.868098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:24.871380 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:24.885766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:24.887488 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:24.897870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1416/2838] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:24.979302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:24.990220 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae82b5-6ef5-4093-9346-c9cd3c9bd01e service placement] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:24.996095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:24.996757 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:24.997041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:24.997314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] PATH_INFO: `/v3/users/096d62efdf83477bb21e3ce26e576b1a` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:24.998451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096d62efdf83477bb21e3ce26e576b1a)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:25.000496 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:25.337646 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096d62efdf83477bb21e3ce26e576b1a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.344695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096d62efdf83477bb21e3ce26e576b1a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.397928 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096d62efdf83477bb21e3ce26e576b1a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.399059 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096d62efdf83477bb21e3ce26e576b1a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.411135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-10194d8c-b15b-4bce-a032-b9a3d62ce843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096d62efdf83477bb21e3ce26e576b1a'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.417478 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1423/2839] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:24 2022] DELETE /identity/v3/users/096d62efdf83477bb21e3ce26e576b1a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:25.657678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:25.669520 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d4b0-d4d0-4217-82ff-f591af82a52f service placement] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:25.727798 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:25.728416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:25.728688 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:25.728954 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] PATH_INFO: `/v3/projects/142d1fa384b646d5b8f921304e432ac2` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:25.730054 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142d1fa384b646d5b8f921304e432ac2)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:25.731993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:25.838817 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142d1fa384b646d5b8f921304e432ac2', 'request_id': 'req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.846589 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142d1fa384b646d5b8f921304e432ac2', 'request_id': 'req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.930459 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142d1fa384b646d5b8f921304e432ac2', 'request_id': 'req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.947174 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] The token cache is being invalidate because project 142d1fa384b646d5b8f921304e432ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:25.947462 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.948119 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4ff2ab4c-de28-46b6-a5f7-4a43c5184a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:25.949675 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1417/2840] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:25 2022] DELETE /identity/v3/projects/142d1fa384b646d5b8f921304e432ac2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:25.954667 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:25.954978 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:25.955249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:25.975662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:25.976867 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:26.035769 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1424/2841] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:26.043826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.044132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.044403 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.063553 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:26.064746 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:26.073007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1418/2842] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:26.077146 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.089280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4a8b2-141f-4b28-9b83-7d51ec9a9936 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.093868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.094460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.094752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.095034 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.095680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:18:26.095983 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.097570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.109741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1425/2843] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:18:26.113832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.123577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d6020-a0be-44d4-a6d6-13b420b4ca60 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.128278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.128866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.129146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.129416 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.130052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.131991 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.229132 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1419/2844] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:26 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:26.233179 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.243711 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a2a4a-0e83-4927-aec3-4400700758cd admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.300653 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.301254 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.301528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.301797 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.302437 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.305001 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.313064 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:26.384176 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1426/2845] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:26 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:26.388280 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.398592 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ca55-0ec8-45de-a15e-0311246c8408 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.403340 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.403968 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.404252 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.404526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.405204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.406840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.418105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1420/2846] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:26.422102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.432886 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba933-f359-4c04-b881-c7a3d59812c7 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.437882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.438771 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.439161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.439540 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.440302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.442047 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b33a1-06b0-45cf-b2ef-71b3fbaa6730 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.453787 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1427/2847] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:18:26.457988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.472250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480e3f-2340-4c52-a01a-f97baa9d59e6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.477690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.478337 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.478611 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.478908 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] PATH_INFO: `/v3/projects/432bd760353042a39d38ae242533c482/users/a49c35c7e0114aae864f81393164e7a5/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.495538 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432bd760353042a39d38ae242533c482, user_id=a49c35c7e0114aae864f81393164e7a5, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.498157 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.583674 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1421/2848] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:26 2022] PUT /identity/v3/projects/432bd760353042a39d38ae242533c482/users/a49c35c7e0114aae864f81393164e7a5/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:26.595280 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.595566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.595841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.625206 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] MFA Rules not processed for user `a49c35c7e0114aae864f81393164e7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:26.626426 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:26.690196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1428/2849] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:26.701742 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:26.703480 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:26.718540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:26.778489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bec2-e03c-4dcb-9df1-723f8d56e244 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:26.784081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716bdc59d9eb46398492fdea1759ed7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:26.784683 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:26.784961 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:26.785236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:26.793801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:26.795409 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac70e-39b6-4aa8-b5fb-87e730d13599 service nova] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:26.804072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1422/2850] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:29.986383 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:30.048695 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e258c8-a66c-4e15-93fe-1729437dee40 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:30.053351 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:30.053977 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:30.054775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:30.055287 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] PATH_INFO: `/v3/users/a49c35c7e0114aae864f81393164e7a5` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:30.056428 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49c35c7e0114aae864f81393164e7a5)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:30.058345 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:30.289862 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49c35c7e0114aae864f81393164e7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:30.297022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49c35c7e0114aae864f81393164e7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:30.381051 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49c35c7e0114aae864f81393164e7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:30.381662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49c35c7e0114aae864f81393164e7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:30.387479 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:30.394306 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49c35c7e0114aae864f81393164e7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:30.400451 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1429/2851] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:29 2022] DELETE /identity/v3/users/a49c35c7e0114aae864f81393164e7a5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:30.404988 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:30.405473 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:30.405582 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:30.425167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:30.426354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:30.485678 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1423/2852] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:30.496030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:30.497442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:30.566614 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a288186-a132-4d5c-876d-ae92da3575f5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:30.570708 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:30.571321 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:30.571594 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:30.571863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:30.580591 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:30.582020 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad482d-8eef-493e-810f-4712efa25c92 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:30.591511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1430/2853] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:31.053464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.055032 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:31.067705 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd32e2-4743-4f80-959c-f4f64ce9dd5b None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.073077 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.073665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.073936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.074207 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] PATH_INFO: `/v3/projects/432bd760353042a39d38ae242533c482` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.075352 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=432bd760353042a39d38ae242533c482)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.077266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.229982 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432bd760353042a39d38ae242533c482', 'request_id': 'req-ee1dab13-db78-4d29-989a-085ae9d6cf2d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:31.235655 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432bd760353042a39d38ae242533c482', 'request_id': 'req-ee1dab13-db78-4d29-989a-085ae9d6cf2d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:31.366267 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432bd760353042a39d38ae242533c482', 'request_id': 'req-ee1dab13-db78-4d29-989a-085ae9d6cf2d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:31.379074 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] The token cache is being invalidate because project 432bd760353042a39d38ae242533c482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:31.381595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:31.381595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ee1dab13-db78-4d29-989a-085ae9d6cf2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:31.381595 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1424/2854] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:31 2022] DELETE /identity/v3/projects/432bd760353042a39d38ae242533c482 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:31.387581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.388050 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.388150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.408819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:31.410008 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:31.467950 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1431/2855] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:31.475703 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.476274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.476405 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.496250 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:31.497440 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:31.505307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1425/2856] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:31.510435 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.520124 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084384ce-8a0a-4005-ae91-c60fc7c91607 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.525061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.525656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.525937 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.526208 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.526915 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:18:31.527218 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.528803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.540057 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1432/2857] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:18:31.544126 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.553117 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573a1ce-c671-47bb-95b0-7b5e1cf013ec None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.558278 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.558913 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.559189 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.559452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.560064 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.561930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.577181 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:31.670890 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1426/2858] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:31 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:31.674935 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.685632 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c116f-3a9b-4f20-b789-5be5639953dc admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.743908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.744508 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.744785 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.745053 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.745725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.747673 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.852093 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1433/2859] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:31 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:31.856407 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.867435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d232-2080-43ed-a444-d811cc4c8ba7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.872803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.872803 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.873059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.873238 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.873878 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.875532 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.885366 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1427/2860] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:31.889235 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.899746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0d37f-87e0-487f-b65d-775a6b59ed55 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.904447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.905030 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.905308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.905579 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.906217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.907840 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1f0c-9470-45f4-9614-68c5507d2749 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:31.909095 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:31.919562 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1434/2861] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:31.927321 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:31.938184 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496000ef-0b02-4541-aef6-bad2e62c93bb admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:31.942951 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:31.943596 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:31.943871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:31.944136 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] PATH_INFO: `/v3/projects/2e35ef2785a64158a28fa3b4a9caa707/users/da41d3b4817e4b9e8d752fa64171951f/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:31.958975 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e35ef2785a64158a28fa3b4a9caa707, user_id=da41d3b4817e4b9e8d752fa64171951f, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:31.961932 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.063740 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1428/2862] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:31 2022] PUT /identity/v3/projects/2e35ef2785a64158a28fa3b4a9caa707/users/da41d3b4817e4b9e8d752fa64171951f/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:32.073725 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.074006 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.074274 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.102850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] MFA Rules not processed for user `da41d3b4817e4b9e8d752fa64171951f`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:32.104055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:32.167385 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1435/2863] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:32.171842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.238451 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02bac-d979-4c2c-90f9-1aa3ed0e25cc admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.243101 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.243700 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.243976 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.244245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.244876 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.246796 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.368301 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1429/2864] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:32 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:32.372163 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.382943 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d7d4-afcf-4e73-a474-59c979ff4f8a None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.439344 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.439970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.440217 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.440489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.441111 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.443071 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.581831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1436/2865] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:32 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:18:32.586183 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.596886 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f2ef-9a93-4cda-8745-4bdc23ebd014 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.601656 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.602260 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.602540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.602846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.603489 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.605097 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.615559 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1430/2866] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:32.619680 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.629762 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e690f7-aeae-4ccf-a311-591e3b1848e6 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.634965 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.635606 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.636153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.636153 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] PATH_INFO: `/v3/projects/769ba953501f4e978f89916546d6c87d/users/1d24dc7a752a433ea66c921fa9f50760/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.651733 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ba953501f4e978f89916546d6c87d, user_id=1d24dc7a752a433ea66c921fa9f50760, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.654462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.763790 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1437/2867] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:32 2022] PUT /identity/v3/projects/769ba953501f4e978f89916546d6c87d/users/1d24dc7a752a433ea66c921fa9f50760/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:32.767820 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.777881 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748779a5-59e6-498a-a238-e308fb57f065 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.833579 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.834113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.834394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.834664 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.835328 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.836981 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887a56-8026-4135-921a-fedc64cc249a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.846846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1431/2868] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:18:32.851553 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:32.861952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e033ae2-3dcb-4b64-8cf3-093d137d4bff admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:32.866654 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:32.868127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.868409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.868686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] PATH_INFO: `/v3/projects/769ba953501f4e978f89916546d6c87d/users/1d24dc7a752a433ea66c921fa9f50760/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.870663 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ba953501f4e978f89916546d6c87d, user_id=1d24dc7a752a433ea66c921fa9f50760, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:32.873394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:32.883525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1438/2869] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:32 2022] PUT /identity/v3/projects/769ba953501f4e978f89916546d6c87d/users/1d24dc7a752a433ea66c921fa9f50760/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:32.894758 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:32.895041 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:32.895318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:32.923632 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] MFA Rules not processed for user `1d24dc7a752a433ea66c921fa9f50760`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:32.924846 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:32.942038 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:32.994357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1432/2870] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:33.014164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:33.014164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:33.051154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:33.086066 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dd7b-2e59-4fc9-83ec-8bfde82322f0 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:33.090122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:33.090717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:33.091022 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:33.091294 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:33.100330 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:33.102403 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:33.111809 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1439/2871] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:33.400029 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:33.401454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:33.413411 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf3d74-2ccf-4e83-b6f9-c121f0a32bc6 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:33.417322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:33.417907 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:33.418180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:33.418442 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:33.476612 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:33.478012 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a961b1-ccf4-442a-b151-6118ceaaba71 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:33.486840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1433/2872] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 18:18:38.704552 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:38.766406 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9edda-ba8e-44ef-9d1c-a2227f80069b service cinder] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:38.770857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:38.771471 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:38.771746 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:38.772014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] PATH_INFO: `/v3/users/da41d3b4817e4b9e8d752fa64171951f` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:38.773850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=da41d3b4817e4b9e8d752fa64171951f)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:38.775793 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:38.966462 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da41d3b4817e4b9e8d752fa64171951f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:38.973967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da41d3b4817e4b9e8d752fa64171951f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.066916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da41d3b4817e4b9e8d752fa64171951f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.067531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da41d3b4817e4b9e8d752fa64171951f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.081078 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da41d3b4817e4b9e8d752fa64171951f'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.087189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1440/2873] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:38 2022] DELETE /identity/v3/users/da41d3b4817e4b9e8d752fa64171951f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:39.092236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:39.092724 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:39.092832 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:39.111883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:39.113071 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:39.171006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1434/2874] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:39.181504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:39.182912 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:39.228084 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:39.241727 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0078c-87ac-4db7-9ca8-b722b7e81eba admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:39.247000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:39.247000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:39.247000 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:39.247329 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:39.256452 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:39.257878 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:39.267682 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1441/2875] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:39.693153 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:39.694645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:39.707727 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8304-dcf9-48c9-a42d-b6fa93309fe5 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:39.713871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:39.714507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:39.714909 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:39.715087 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] PATH_INFO: `/v3/projects/2e35ef2785a64158a28fa3b4a9caa707` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:39.716219 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e35ef2785a64158a28fa3b4a9caa707)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:39.718113 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:39.846331 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:39.847752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e35ef2785a64158a28fa3b4a9caa707', 'request_id': 'req-2c31c8cd-005c-42ad-a40c-9818053b153a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.853840 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e35ef2785a64158a28fa3b4a9caa707', 'request_id': 'req-2c31c8cd-005c-42ad-a40c-9818053b153a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.943508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e35ef2785a64158a28fa3b4a9caa707', 'request_id': 'req-2c31c8cd-005c-42ad-a40c-9818053b153a'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.955486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] The token cache is being invalidate because project 2e35ef2785a64158a28fa3b4a9caa707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:39.958307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.958307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:39.958307 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1435/2876] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:39 2022] DELETE /identity/v3/projects/2e35ef2785a64158a28fa3b4a9caa707 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:39.963213 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:39.972987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c3afc-926e-4ea7-b012-27a0f6bacdc8 service neutron] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:40.030302 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:40.030971 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:40.031252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:40.031527 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] PATH_INFO: `/v3/users/1d24dc7a752a433ea66c921fa9f50760` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:40.032658 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d24dc7a752a433ea66c921fa9f50760)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:40.034578 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:40.272847 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d24dc7a752a433ea66c921fa9f50760'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.280887 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d24dc7a752a433ea66c921fa9f50760'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.371698 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d24dc7a752a433ea66c921fa9f50760'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.372348 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d24dc7a752a433ea66c921fa9f50760'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.386171 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-4b359fb1-7191-4ba3-8a97-d33c62996fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d24dc7a752a433ea66c921fa9f50760'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.392309 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1442/2877] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:39 2022] DELETE /identity/v3/users/1d24dc7a752a433ea66c921fa9f50760 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:40.817350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:40.818930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:40.832129 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c8cd-005c-42ad-a40c-9818053b153a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:40.888393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:40.889016 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:40.889319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:40.889586 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] PATH_INFO: `/v3/projects/769ba953501f4e978f89916546d6c87d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:40.890687 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ba953501f4e978f89916546d6c87d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:40.892591 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:40.994299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ba953501f4e978f89916546d6c87d', 'request_id': 'req-ac06c5cd-da3b-4690-a4ab-db729e7630c2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:40.999865 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ba953501f4e978f89916546d6c87d', 'request_id': 'req-ac06c5cd-da3b-4690-a4ab-db729e7630c2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:41.066949 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ba953501f4e978f89916546d6c87d', 'request_id': 'req-ac06c5cd-da3b-4690-a4ab-db729e7630c2'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:41.079006 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] The token cache is being invalidate because project 769ba953501f4e978f89916546d6c87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:41.079296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:41.079922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-ac06c5cd-da3b-4690-a4ab-db729e7630c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:41.081454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1436/2878] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:40 2022] DELETE /identity/v3/projects/769ba953501f4e978f89916546d6c87d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:41.086858 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.087338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.087446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.108152 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:41.109362 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:41.167833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1443/2879] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:41.175435 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558e18-064e-44ad-a843-5365036931d2 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.175720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558e18-064e-44ad-a843-5365036931d2 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.175992 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558e18-064e-44ad-a843-5365036931d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.196654 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-69558e18-064e-44ad-a843-5365036931d2 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:41.197866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-69558e18-064e-44ad-a843-5365036931d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:41.205701 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1437/2880] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:41.209782 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.215486 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:41.220692 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d6ad-42fe-445a-965a-e6ae5610acb2 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.225240 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.225853 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.226131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.226415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] PATH_INFO: `/v3/domains` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.227640 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81628) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:18:41.227932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.229514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.240908 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1444/2881] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:18:41.246842 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558e18-064e-44ad-a843-5365036931d2 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.256079 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558e18-064e-44ad-a843-5365036931d2 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.260871 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.261461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.261739 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.262007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.262633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.264561 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.350105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1438/2882] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:41.354876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.364592 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b23e4-eca2-4956-a401-1baf4ce0a69a admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.423767 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.424355 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.424629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.424897 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.425523 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.427472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.530092 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1445/2883] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:41.534392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.544633 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf18-c323-4a83-ac0a-81795b271fae admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.549281 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.549863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.550138 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.550402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.551061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.552670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.562453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1439/2884] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:41.566416 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.577127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd57c-3149-4d66-816f-d1576b977459 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.581951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.582566 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.582882 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.583151 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.583788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.585376 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1cce7-e2c8-4975-a79d-580579dcfd5b admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.596816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1446/2885] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:41.600883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.610894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb477182-8dc5-40b0-b335-8ca8dd85d6a4 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.615496 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.616155 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.616429 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.616695 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] PATH_INFO: `/v3/projects/0e1fa5981e64444eb652099bdfa74f78/users/f94a2c730556474885ceb883133d80c7/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.631517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1fa5981e64444eb652099bdfa74f78, user_id=f94a2c730556474885ceb883133d80c7, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.634812 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:41.754905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1440/2886] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:41 2022] PUT /identity/v3/projects/0e1fa5981e64444eb652099bdfa74f78/users/f94a2c730556474885ceb883133d80c7/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:41.765675 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.765955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.766234 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.793880 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] MFA Rules not processed for user `f94a2c730556474885ceb883133d80c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:41.795135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:41.858060 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1447/2887] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:41.862439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:41.866884 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:41.924091 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ec66-903e-4444-816f-46a6d60003c5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:41.929486 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:41.930614 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:41.930925 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:41.934464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:41.934464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:41.934464 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.047308 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1441/2888] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:41 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:42.051424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.062402 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71e95d-bd45-4441-a866-e832988c4284 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.111864 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:42.117409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.118642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.125765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.125765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] PATH_INFO: `/v3/users` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.125765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.125765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.218193 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1448/2889] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:42 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:18:42.222178 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.233160 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9919b7-db04-4917-a3ea-25ee8fd9ad37 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.237853 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.238447 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.238750 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.239031 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.239672 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.241263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.252525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1442/2890] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:42.256586 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.266593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d8ee-f88f-4e52-9234-ad3118935008 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.271445 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.272081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.272360 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.272636 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] PATH_INFO: `/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b/users/12f2f7b1bc15483fbf7b14396087ac7d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.287332 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b0e35a45ce41ab9933e4bcf7b55e9b, user_id=12f2f7b1bc15483fbf7b14396087ac7d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.290583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.372558 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1449/2891] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:42 2022] PUT /identity/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b/users/12f2f7b1bc15483fbf7b14396087ac7d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:42.376568 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.386888 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842384c9-7a61-489e-ae7e-76b4cade76f7 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.445851 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.446452 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.446755 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.447024 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.447661 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.449256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714c3fe-050b-4fb1-a4e9-33382a12f774 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.459057 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1443/2892] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:42.463788 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.474120 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3503a8d-8982-4533-9ca1-c425bb3d2e38 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.479490 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.480125 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.480398 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.480686 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] PATH_INFO: `/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b/users/12f2f7b1bc15483fbf7b14396087ac7d/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.482599 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b0e35a45ce41ab9933e4bcf7b55e9b, user_id=12f2f7b1bc15483fbf7b14396087ac7d, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.485233 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.495710 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1450/2893] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:42 2022] PUT /identity/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b/users/12f2f7b1bc15483fbf7b14396087ac7d/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:42.506966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.507254 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.507525 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.537210 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] MFA Rules not processed for user `12f2f7b1bc15483fbf7b14396087ac7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:42.538400 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:42.601226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:42.607063 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1444/2894] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:18:42.618358 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.620098 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:42.679561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355ff5c-7f71-4f8f-bcdf-b9d2391276f5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.683442 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.684041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.684315 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.684582 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.693366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.694815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c83fc-cd0a-4bb0-99a3-75ac6f4694ff service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.704472 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1451/2895] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:42.734385 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:42.800350 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b76ad-33d7-4072-b3fb-15191aecc9b8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:42.805105 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:42.805767 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:42.806052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:42.806327 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] PATH_INFO: `/v3/users/f94a2c730556474885ceb883133d80c7` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:42.807526 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94a2c730556474885ceb883133d80c7)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:42.809438 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:42.985477 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94a2c730556474885ceb883133d80c7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:42.992598 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94a2c730556474885ceb883133d80c7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.057461 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94a2c730556474885ceb883133d80c7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.070050 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94a2c730556474885ceb883133d80c7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.071318 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94a2c730556474885ceb883133d80c7'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.077319 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1445/2896] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:42 2022] DELETE /identity/v3/users/f94a2c730556474885ceb883133d80c7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:43.081951 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:43.082238 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:43.082514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:43.102370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:43.103425 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:43.163732 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1452/2897] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:43.173725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:43.175725 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:43.233953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce39b3-355b-46a7-9740-cd2783204118 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:43.237619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:43.238221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:43.238501 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:43.238800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:43.248078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:43.249504 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:43.259577 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1446/2898] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:43.682649 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:43.684122 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:43.697741 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d4f2-754b-48de-ba60-ced8de8a914d None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:43.702650 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:43.703314 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:43.703593 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:43.703866 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] PATH_INFO: `/v3/projects/0e1fa5981e64444eb652099bdfa74f78` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:43.705019 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1fa5981e64444eb652099bdfa74f78)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:43.707033 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:43.811423 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:43.812765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1fa5981e64444eb652099bdfa74f78', 'request_id': 'req-cdf7866d-7a88-446a-a744-f7bbd069a7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.818848 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1fa5981e64444eb652099bdfa74f78', 'request_id': 'req-cdf7866d-7a88-446a-a744-f7bbd069a7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.824298 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1fa5981e64444eb652099bdfa74f78', 'request_id': 'req-cdf7866d-7a88-446a-a744-f7bbd069a7a5'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.907910 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] The token cache is being invalidate because project 0e1fa5981e64444eb652099bdfa74f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:43.908202 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.908850 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:43.910347 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1453/2899] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:43 2022] DELETE /identity/v3/projects/0e1fa5981e64444eb652099bdfa74f78 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:43.914894 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:43.924634 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d651521-29b3-43cd-905c-fa0fe5be5890 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:43.942312 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:43.982801 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:43.983437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:43.983738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:43.984000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] PATH_INFO: `/v3/users/12f2f7b1bc15483fbf7b14396087ac7d` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:43.985131 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f2f7b1bc15483fbf7b14396087ac7d)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:43.987213 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:44.136807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f2f7b1bc15483fbf7b14396087ac7d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.143395 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f2f7b1bc15483fbf7b14396087ac7d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.203379 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f2f7b1bc15483fbf7b14396087ac7d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.216218 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f2f7b1bc15483fbf7b14396087ac7d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.216852 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-872ffd2a-222f-433d-bc16-f1328a88b9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f2f7b1bc15483fbf7b14396087ac7d'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.222650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1447/2900] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:43 2022] DELETE /identity/v3/users/12f2f7b1bc15483fbf7b14396087ac7d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:44.645512 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:44.647114 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:44.661752 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7866d-7a88-446a-a744-f7bbd069a7a5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:44.731319 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:44.731942 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:44.732246 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:44.732520 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] PATH_INFO: `/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:44.733642 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b0e35a45ce41ab9933e4bcf7b55e9b)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:44.735570 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:44.834643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b0e35a45ce41ab9933e4bcf7b55e9b', 'request_id': 'req-30137f41-f0d3-4495-9b4b-4ac5601005e7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.841772 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b0e35a45ce41ab9933e4bcf7b55e9b', 'request_id': 'req-30137f41-f0d3-4495-9b4b-4ac5601005e7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.847765 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b0e35a45ce41ab9933e4bcf7b55e9b', 'request_id': 'req-30137f41-f0d3-4495-9b4b-4ac5601005e7'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.911178 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] The token cache is being invalidate because project 92b0e35a45ce41ab9933e4bcf7b55e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:44.911400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.912016 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-30137f41-f0d3-4495-9b4b-4ac5601005e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:44.913501 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1454/2901] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:44 2022] DELETE /identity/v3/projects/92b0e35a45ce41ab9933e4bcf7b55e9b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:44.918393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:44.918680 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:44.919098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:44.939814 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:44.941033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:45.001047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1448/2902] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:45.009304 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.009583 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.009857 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.029456 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:45.030656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:45.038447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1455/2903] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:45.042795 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.052299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6a01-e8b7-44e5-aad0-8f62c5ca3a7d None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.057562 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.058147 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.058422 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.058689 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.059356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:18:45.059651 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.061221 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.073453 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1449/2904] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 18:18:45.080726 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.090629 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746638c-d2f2-4b63-ba71-1a43f288fa52 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.095367 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.095958 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.096243 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.096504 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.097135 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.099081 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.188932 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1456/2905] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 18:18:45.192930 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.203967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4004bf-ad21-4320-8252-d576f581afa6 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.228887 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:45.260670 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.261266 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.261542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.261810 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.262437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.264375 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.366339 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1450/2906] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/users => generated 301 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:45.371079 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.381514 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2946185-5370-41da-b801-fe4e02348136 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.386293 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.386920 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.387196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.387500 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.388162 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.389729 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.399427 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1457/2907] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:45.403392 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.413410 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a844bb-8a81-4b65-8470-1209353a697b admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.419270 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.419858 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.420135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.420402 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.421040 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.422626 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb7384-3656-4b0d-9dc6-a704b08912e9 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.433517 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1451/2908] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:45.437819 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.448088 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b1b4-38b0-4b89-8526-a3a64058b20e admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.452652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.453284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.453561 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.453831 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] PATH_INFO: `/v3/projects/9f17ba0a16544ac29522937ec0b757d9/users/d35f9e8d77244d038c84bb04b7aa282c/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.468370 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f17ba0a16544ac29522937ec0b757d9, user_id=d35f9e8d77244d038c84bb04b7aa282c, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.471044 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.543288 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1458/2909] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:45 2022] PUT /identity/v3/projects/9f17ba0a16544ac29522937ec0b757d9/users/d35f9e8d77244d038c84bb04b7aa282c/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:45.553869 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.554154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.554431 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.582640 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] MFA Rules not processed for user `d35f9e8d77244d038c84bb04b7aa282c`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:45.583879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:45.648507 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1452/2910] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:45.653815 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.658366 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:45.716249 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fd285-f79f-40ac-b1f3-c3ceb3ae6ee5 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.721374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.721980 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.722259 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.722531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.723184 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.725086 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.784161 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1459/2911] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:45.788325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.799540 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f852-1565-4d59-b53e-a303b18b8d87 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.854454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.855078 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.855357 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.855621 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.856245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.858137 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.943439 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1453/2912] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:45 2022] POST /identity/v3/users => generated 306 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:45.948061 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.958776 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cc016-1c16-4b49-906b-c8c4b6197876 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.964546 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.965170 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.965447 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.965717 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:45.966410 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:45.968054 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:45.979090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1460/2913] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:45.983236 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:45.993081 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8cec-80b6-435e-a25d-19fd9947ccb0 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:45.998070 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:45.998720 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:45.999026 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:45.999303 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] PATH_INFO: `/v3/projects/9261481cea7c4e47b839b75a6c5adc94/users/543afe95f1a343f09db2737897eb51fe/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.014578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9261481cea7c4e47b839b75a6c5adc94, user_id=543afe95f1a343f09db2737897eb51fe, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:46.017257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:46.059019 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:46.063506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1454/2914] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:45 2022] PUT /identity/v3/projects/9261481cea7c4e47b839b75a6c5adc94/users/543afe95f1a343f09db2737897eb51fe/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:46.067439 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:46.077939 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f84167-8e31-4f8b-966d-f6b482b9e4ce admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:46.132816 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:46.133409 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:46.133684 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:46.133952 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.135188 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:46.136868 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86b9d-48e6-4a82-92e9-2e9103691d9c admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:46.146394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1461/2915] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:46.151356 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:46.161476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283870cf-9a62-4c87-a6aa-390821334a35 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:46.166345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:46.167030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:46.167310 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:46.167603 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] PATH_INFO: `/v3/projects/9261481cea7c4e47b839b75a6c5adc94/users/543afe95f1a343f09db2737897eb51fe/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.169483 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9261481cea7c4e47b839b75a6c5adc94, user_id=543afe95f1a343f09db2737897eb51fe, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:46.172135 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:46.182394 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1455/2916] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:46 2022] PUT /identity/v3/projects/9261481cea7c4e47b839b75a6c5adc94/users/543afe95f1a343f09db2737897eb51fe/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:46.193581 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:46.193872 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:46.194149 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.223777 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] MFA Rules not processed for user `543afe95f1a343f09db2737897eb51fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:46.224916 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:46.287165 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:46.292509 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1462/2917] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:18:46.344154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:46.344154 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:46.361751 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43602418-0d74-4579-9651-a2db9bd4ab29 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:46.365393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:46.365980 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:46.366255 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:46.366521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.376399 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:46.378125 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:46.388355 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1456/2918] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:46.578556 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:46.589489 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137095-563d-4cc5-a15f-87db7ca0bbe5 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:46.593090 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:46.593681 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:46.593955 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:46.594221 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:46.649607 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:46.651590 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945b82-6b7f-417a-afb3-7d9ce902ba5f service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:46.660448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1463/2919] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:51.810000 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:51.871644 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccbb4b-6d64-4af8-ba49-f2734a051633 service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:51.876389 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:51.877014 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:51.877323 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:51.877594 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] PATH_INFO: `/v3/users/d35f9e8d77244d038c84bb04b7aa282c` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:51.878838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35f9e8d77244d038c84bb04b7aa282c)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:51.880778 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:52.046256 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35f9e8d77244d038c84bb04b7aa282c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:52.053047 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35f9e8d77244d038c84bb04b7aa282c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:52.106903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35f9e8d77244d038c84bb04b7aa282c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:52.127590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35f9e8d77244d038c84bb04b7aa282c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:52.127590 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35f9e8d77244d038c84bb04b7aa282c'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:52.131146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1457/2920] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:51 2022] DELETE /identity/v3/users/d35f9e8d77244d038c84bb04b7aa282c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:52.136502 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:52.137899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:52.137899 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:52.157164 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:52.158388 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:52.216755 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1464/2921] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:52.226437 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:52.227879 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:52.238905 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:52.285929 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74699-c39f-47e5-827d-20333d85b4d5 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:52.289698 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:52.290296 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:52.290578 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:52.291059 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:52.300075 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:52.301448 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:52.311645 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1458/2922] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:52.967662 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:52.969158 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:52.983644 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edac5c-42e6-4e47-8f3e-08df43d6ee42 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:52.988823 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:52.989460 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:52.989906 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:52.990181 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] PATH_INFO: `/v3/projects/9f17ba0a16544ac29522937ec0b757d9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:52.991394 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f17ba0a16544ac29522937ec0b757d9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:52.993537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:53.085894 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f17ba0a16544ac29522937ec0b757d9', 'request_id': 'req-ef530957-590e-49d5-b8c8-672d500e1633'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.093317 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f17ba0a16544ac29522937ec0b757d9', 'request_id': 'req-ef530957-590e-49d5-b8c8-672d500e1633'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.099131 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f17ba0a16544ac29522937ec0b757d9', 'request_id': 'req-ef530957-590e-49d5-b8c8-672d500e1633'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.168215 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] The token cache is being invalidate because project 9f17ba0a16544ac29522937ec0b757d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:53.168901 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.169335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.170869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1465/2923] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:52 2022] DELETE /identity/v3/projects/9f17ba0a16544ac29522937ec0b757d9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:53.174800 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:53.185857 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7abe-ef57-4640-a7f1-def1b772ea4e service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:53.244966 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:53.245515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:53.245870 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:53.246752 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] PATH_INFO: `/v3/users/543afe95f1a343f09db2737897eb51fe` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:53.247257 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=543afe95f1a343f09db2737897eb51fe)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:53.249167 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:53.435557 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543afe95f1a343f09db2737897eb51fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.442299 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543afe95f1a343f09db2737897eb51fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.501007 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543afe95f1a343f09db2737897eb51fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.514322 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543afe95f1a343f09db2737897eb51fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.515030 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-45f7b223-debb-48ef-a318-80afcf02de7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543afe95f1a343f09db2737897eb51fe'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:53.520963 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1459/2924] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:53 2022] DELETE /identity/v3/users/543afe95f1a343f09db2737897eb51fe => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:53.925493 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:53.926994 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:53.940250 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef530957-590e-49d5-b8c8-672d500e1633 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:53.959433 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:54.002166 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.002707 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.003014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.003283 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] PATH_INFO: `/v3/projects/9261481cea7c4e47b839b75a6c5adc94` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.004396 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9261481cea7c4e47b839b75a6c5adc94)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.006829 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.136803 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9261481cea7c4e47b839b75a6c5adc94', 'request_id': 'req-0b77d269-ae33-4968-b974-d07727a9d732'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:54.142863 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9261481cea7c4e47b839b75a6c5adc94', 'request_id': 'req-0b77d269-ae33-4968-b974-d07727a9d732'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:54.148241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9261481cea7c4e47b839b75a6c5adc94', 'request_id': 'req-0b77d269-ae33-4968-b974-d07727a9d732'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:54.220739 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] The token cache is being invalidate because project 9261481cea7c4e47b839b75a6c5adc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:54.221511 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:54.221770 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-0b77d269-ae33-4968-b974-d07727a9d732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:54.223285 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1466/2925] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:53 2022] DELETE /identity/v3/projects/9261481cea7c4e47b839b75a6c5adc94 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:54.228325 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.229229 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.229404 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.250004 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:54.251476 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:54.277941 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:54.312170 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1460/2926] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:54.319961 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.320245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.320515 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.340763 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:54.341985 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:54.350107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1467/2927] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:54.355508 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.366005 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd8f05-6593-4af9-beed-54499cdc1cf0 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.371783 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.372376 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.372652 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.372922 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.373563 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 18:18:54.373866 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.375506 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.387345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1461/2928] 10.222.0.58 () {58 vars in 1153 bytes} [Thu Sep 1 18:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 18:18:54.391613 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.400989 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3e20b-89b8-4c9a-acfa-17f1da24fca9 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.405957 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.406539 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.406869 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.407143 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.407759 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.409666 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.554446 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1468/2929] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:54 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:54.562158 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.575146 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df5c4-40b3-47fc-856b-ca51b85bf1dd admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.632741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.633338 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.633619 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.633889 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.634524 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.637515 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.735558 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1462/2930] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:54 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:54.740014 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.751688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3980b-f87a-4ab9-98d8-7e3f0b6066bc admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.757241 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.757833 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.758106 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.758374 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.759041 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.761368 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.771531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1469/2931] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:54.776650 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.786627 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296a83-9e8e-4bf5-8e41-acfe5f6ef722 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.791738 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.792712 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.792993 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.793263 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.793903 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.795518 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f8967-7495-4e8f-8654-c557780de865 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.806133 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1463/2932] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 18:18:54.810808 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:54.821305 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5f7e-0776-4842-8644-638a0e1ad977 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:54.826584 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:54.827245 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] REQUEST_METHOD: `PUT` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.827525 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.827795 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] PATH_INFO: `/v3/projects/28ba917150c94a0880741a2ee20ae133/users/fb25634b187a4502b955eec99ce450a8/roles/cee4828f017b4ac7a91a87c02aef60b9` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.842197 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ba917150c94a0880741a2ee20ae133, user_id=fb25634b187a4502b955eec99ce450a8, role_id=cee4828f017b4ac7a91a87c02aef60b9)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:54.844841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:54.924507 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1470/2933] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:54 2022] PUT /identity/v3/projects/28ba917150c94a0880741a2ee20ae133/users/fb25634b187a4502b955eec99ce450a8/roles/cee4828f017b4ac7a91a87c02aef60b9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:54.936354 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:54.936741 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:54.937102 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:54.966226 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.auth.core [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] MFA Rules not processed for user `fb25634b187a4502b955eec99ce450a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:54.967474 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:55.031838 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1464/2934] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 18:18:55.036778 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.085893 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:55.099929 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d97-e241-4a88-9c1c-bf226689faac admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.105154 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.105754 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.106036 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.106308 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.106967 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.108876 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.200997 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1471/2935] 10.222.0.58 () {60 vars in 1153 bytes} [Thu Sep 1 18:18:55 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:55.205345 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.216494 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a324f-0370-4fa9-8136-dc5ed2c402a8 None None] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.240781 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:55.273450 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.274061 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] REQUEST_METHOD: `POST` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.274576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.275237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] PATH_INFO: `/v3/users` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.275958 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.277934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.365934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1465/2936] 10.222.0.58 () {60 vars in 1144 bytes} [Thu Sep 1 18:18:55 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 18:18:55.369844 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.381272 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52de6-1f2f-4109-93a3-84d568ad0925 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.386335 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.386962 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.387284 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.387554 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.388196 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.389780 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.399730 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1472/2937] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:55.403985 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.413818 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7305e2-cc87-48f1-b3a3-4a30013b83ce admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.419243 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.419875 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.420152 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.420417 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] PATH_INFO: `/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d/users/d679d035319944e695e5ebb9fb143ed4/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.435306 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cfbbcb6f62487cb7f12cc61a72252d, user_id=d679d035319944e695e5ebb9fb143ed4, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.437931 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.525118 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1466/2938] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:55 2022] PUT /identity/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d/users/d679d035319944e695e5ebb9fb143ed4/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:55.536185 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.547674 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807840ba-a1f5-4e19-9b75-bee0777e3cc1 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.605931 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.606528 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.606841 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.607115 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.607750 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.609338 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd3ca-7221-4c62-96ab-c26aeeb46ff4 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.619239 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1473/2939] 10.222.0.58 () {58 vars in 1122 bytes} [Thu Sep 1 18:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 18:18:55.624498 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.635058 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00b41b-8291-4087-9cef-04caf36a7caa admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.639827 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.642539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.642539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.642539 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] PATH_INFO: `/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d/users/d679d035319944e695e5ebb9fb143ed4/roles/d8ad09c6864f4a43b015f988202955a4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.643011 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cfbbcb6f62487cb7f12cc61a72252d, user_id=d679d035319944e695e5ebb9fb143ed4, role_id=d8ad09c6864f4a43b015f988202955a4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.645686 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.656885 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1467/2940] 10.222.0.58 () {60 vars in 1483 bytes} [Thu Sep 1 18:18:55 2022] PUT /identity/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d/users/d679d035319944e695e5ebb9fb143ed4/roles/d8ad09c6864f4a43b015f988202955a4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 18:18:55.667773 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.672656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.672656 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.695448 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] MFA Rules not processed for user `d679d035319944e695e5ebb9fb143ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:55.696645 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:55.767609 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1474/2941] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:55.782665 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:55.784576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:55.850148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3af3fb-3e70-4ada-86f9-1fcb9b13df89 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:55.853883 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:55.855072 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:55.855953 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:55.856227 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:55.865412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:55.866863 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:55.876807 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1468/2942] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:56.181415 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:56.191531 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619053-4e02-44da-bcf0-49a35b76750b None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:56.195055 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e162ed7a337a40f5875048254f16a2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:56.195643 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:56.195919 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:56.196189 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:56.238600 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:56.254038 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:56.255537 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554a91-b2f8-4574-a461-1684269ad3c7 service cinder] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:56.265102 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1475/2943] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:56.708584 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:56.771013 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8a616-451d-4f7d-9846-0bd68be17fbb service cinder] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:56.775454 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:56.776067 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:56.777826 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:56.778089 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] PATH_INFO: `/v3/users/fb25634b187a4502b955eec99ce450a8` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:56.779274 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb25634b187a4502b955eec99ce450a8)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:56.781169 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:56.803834 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:56.991749 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb25634b187a4502b955eec99ce450a8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.000427 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb25634b187a4502b955eec99ce450a8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.074412 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb25634b187a4502b955eec99ce450a8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.086934 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb25634b187a4502b955eec99ce450a8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.091180 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb25634b187a4502b955eec99ce450a8'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.094033 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1469/2944] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:56 2022] DELETE /identity/v3/users/fb25634b187a4502b955eec99ce450a8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:57.098473 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] REQUEST_METHOD: `POST` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:57.099037 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:57.099150 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:57.118505 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.auth.core [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] MFA Rules not processed for user `d383e5f449b94c0eb3484442f9ddde97`. Rule list: `[]` (Enabled: `True`). {{(pid=81628) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 18:18:57.119839 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:57.179688 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1476/2945] 10.222.0.58 () {58 vars in 958 bytes} [Thu Sep 1 18:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 18:18:57.190744 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:57.192148 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:57.250272 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80b0b7-ba9f-433e-b9ef-b16fc3b4698a admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:57.253867 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae3b9603f0b45cebed05cdeb0d50be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:57.254576 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:57.254933 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:57.255204 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:57.264391 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:57.265799 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:57.275017 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1470/2946] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:18:57.670269 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:57.671775 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:57.685145 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72acf3-8df4-4fa0-a426-74fb25519582 None None] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:57.690820 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:57.691464 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:57.691745 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:57.692015 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] PATH_INFO: `/v3/projects/28ba917150c94a0880741a2ee20ae133` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:57.693194 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ba917150c94a0880741a2ee20ae133)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:57.695232 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:57.787652 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ba917150c94a0880741a2ee20ae133', 'request_id': 'req-2091682a-e442-4e21-8cea-4a17d5a66559'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.794475 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ba917150c94a0880741a2ee20ae133', 'request_id': 'req-2091682a-e442-4e21-8cea-4a17d5a66559'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.800075 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ba917150c94a0880741a2ee20ae133', 'request_id': 'req-2091682a-e442-4e21-8cea-4a17d5a66559'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.877046 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] The token cache is being invalidate because project 28ba917150c94a0880741a2ee20ae133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:57.877334 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.877995 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:57.879518 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1477/2947] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:57 2022] DELETE /identity/v3/projects/28ba917150c94a0880741a2ee20ae133 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:57.883542 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:57.893766 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981b5ed-486e-4ff9-947f-9885ca8d49b6 service neutron] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:57.950271 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:57.950965 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:57.951247 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:57.951521 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] PATH_INFO: `/v3/users/d679d035319944e695e5ebb9fb143ed4` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:57.952662 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d679d035319944e695e5ebb9fb143ed4)` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:57.954560 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:58.135667 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:58.138230 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd679d035319944e695e5ebb9fb143ed4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.145393 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd679d035319944e695e5ebb9fb143ed4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.197775 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd679d035319944e695e5ebb9fb143ed4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.210690 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd679d035319944e695e5ebb9fb143ed4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.213425 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.notifications [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd679d035319944e695e5ebb9fb143ed4'} {{(pid=81629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.220245 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1471/2948] 10.222.0.58 () {58 vars in 1224 bytes} [Thu Sep 1 18:18:57 2022] DELETE /identity/v3/users/d679d035319944e695e5ebb9fb143ed4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:18:58.599575 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Authenticating user token {{(pid=81628) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:18:58.601127 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.fernet_utils [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81628) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:18:58.616913 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091682a-e442-4e21-8cea-4a17d5a66559 admin admin] Validating token access rules against request {{(pid=81628) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:18:58.676837 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd383e5f449b94c0eb3484442f9ddde97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c7134db2ce4630a56e3b2cec77b0cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81628) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:18:58.677400 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:18:58.677678 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:18:58.677970 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] PATH_INFO: `/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d` {{(pid=81628) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:18:58.679107 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cfbbcb6f62487cb7f12cc61a72252d)` {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:18:58.681043 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] RBAC: Authorization granted {{(pid=81628) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:18:58.687424 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:58.782987 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cfbbcb6f62487cb7f12cc61a72252d', 'request_id': 'req-9bc69e90-14b8-493a-90f2-3c94822f3a70'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.789252 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cfbbcb6f62487cb7f12cc61a72252d', 'request_id': 'req-9bc69e90-14b8-493a-90f2-3c94822f3a70'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.795898 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cfbbcb6f62487cb7f12cc61a72252d', 'request_id': 'req-9bc69e90-14b8-493a-90f2-3c94822f3a70'} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.884801 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] The token cache is being invalidate because project 58cfbbcb6f62487cb7f12cc61a72252d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81628) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 18:18:58.885091 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.885714 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG keystone.notifications [None req-9bc69e90-14b8-493a-90f2-3c94822f3a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81628) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 18:18:58.887380 dv-cinder-749155-10-smb devstack@keystone.service[81628]: [pid: 81628|app: 0|req: 1478/2949] 10.222.0.58 () {58 vars in 1233 bytes} [Thu Sep 1 18:18:58 2022] DELETE /identity/v3/projects/58cfbbcb6f62487cb7f12cc61a72252d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 18:19:08.267052 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=13,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:19:08.881604 dv-cinder-749155-10-smb devstack@keystone.service[81628]: DEBUG dbcounter [-] [81628] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:55.306343 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Authenticating user token {{(pid=81629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 18:22:55.307845 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:22:55.450371 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bcc77-7d7b-4698-ae2c-6b3519fad542 admin admin] Validating token access rules against request {{(pid=81629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 18:22:55.509333 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb57878f024c05bdc9166eea624e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef03387a4c654f8d9aa777afe8877a9f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 18:22:55.509936 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] REQUEST_METHOD: `GET` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 18:22:55.510216 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] SCRIPT_NAME: `/identity` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 18:22:55.510487 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 18:22:55.512237 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.fernet_utils [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 18:22:55.523967 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 18:22:55.525523 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed5254-1a17-4e07-824c-c39fd2e77f82 service placement] RBAC: Authorization granted {{(pid=81629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 18:22:55.535421 dv-cinder-749155-10-smb devstack@keystone.service[81629]: [pid: 81629|app: 0|req: 1472/2950] 10.222.0.58 () {60 vars in 1365 bytes} [Thu Sep 1 18:22:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 18:23:05.531098 dv-cinder-749155-10-smb devstack@keystone.service[81629]: DEBUG dbcounter [-] [81629] Writing DB stats keystone:SELECT=89 {{(pid=81629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}